Sep 16 08:28:51 devstack cinder-volume[75251]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 16 08:28:51 devstack cinder-volume[75251]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 16 08:28:51 devstack cinder-volume[75251]: we strongly recommend against using it for new projects.
Sep 16 08:28:51 devstack cinder-volume[75251]: If you are already using Eventlet, we recommend migrating to a different
Sep 16 08:28:51 devstack cinder-volume[75251]: framework.  For more detail see
Sep 16 08:28:51 devstack cinder-volume[75251]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 16 08:28:51 devstack cinder-volume[75251]:   import eventlet  # noqa
Sep 16 08:28:53 devstack cinder-volume[75251]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75251) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 08:28:53 devstack cinder-volume[75251]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75251) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 08:28:53 devstack cinder-volume[75251]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75251) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 08:28:54 devstack cinder-volume[75251]: INFO dbcounter [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Registered counter for database cinder
Sep 16 08:28:54 devstack cinder-volume[75251]: DEBUG oslo_db.sqlalchemy.engines [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75251) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG dbcounter [-] [75251] Writer thread running {{(pid=75251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 08:28:55 devstack cinder-volume[75251]: INFO cinder.rpc [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 16 08:28:55 devstack cinder-volume[75251]: INFO cinder.rpc [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_db.sqlalchemy.engines [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75251) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:28:55 devstack cinder-volume[75251]: INFO cinder.volume.manager [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Determined volume DB was empty at startup.
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG cinder.volume.manager [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75251) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 16 08:28:55 devstack cinder-volume[75251]: INFO cinder.volume.manager [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 16 08:28:55 devstack cinder-volume[75251]: WARNING stevedore.named [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 08:28:55 devstack cinder-volume[75251]: WARNING castellan.key_manager [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 08:28:55 devstack cinder-volume[75251]: WARNING cinder.keymgr.conf_key_mgr [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG cinder.volume.drivers.lvm [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75251) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_concurrency.processutils [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] CMD "cinder-rtstool verify" returned: 0 in 0.414s {{(pid=75251) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_db.sqlalchemy.engines [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75251) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:28:55 devstack cinder-volume[75251]: INFO cinder.rpc [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 16 08:28:55 devstack cinder-volume[75251]: INFO cinder.rpc [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 16 08:28:55 devstack cinder-volume[75251]: WARNING stevedore.named [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 08:28:55 devstack cinder-volume[75251]: WARNING castellan.key_manager [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 08:28:55 devstack cinder-volume[75251]: INFO cinder.volume.manager [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_db.sqlalchemy.engines [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75251) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:28:55 devstack cinder-volume[75251]: INFO oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Starting 1 workers
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Started child 75394 {{(pid=75251) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Full set of CONF: {{(pid=75251) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] ******************************************************************************** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Configuration options gathered from: {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] ================================================================================ {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] allow_availability_zone_fallback = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] allow_compression_on_image_upload = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] allowed_direct_url_schemes     = [] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] api_rate_limit                 = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] auth_strategy                  = keystone {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] az_cache_duration              = 3600 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_availability_zone      = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_host                   = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_name                   = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_stats_polling_interval = 60 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backup_api_class               = cinder.backup.api.API {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backup_name_template           = backup-%s {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backup_use_same_host           = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backup_use_temp_snapshot       = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] chap_password                  = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] chap_username                  =  {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cinder_internal_tenant_project_id = a9b1a63a153448a48c5c0254ea035879 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cinder_internal_tenant_user_id = 747968c8c9fa4c738636a56479d7729a {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cloned_volume_same_az          = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cluster                        = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] compression_format             = gzip {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] compute_api_class              = cinder.compute.nova.API {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] config_dir                     = [] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] config_source                  = [] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] control_exchange               = openstack {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] debug                          = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] default_availability_zone      = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] default_group_type             = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] default_volume_type            = lvmdriver-1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] disk_geometry                  = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] driver_client_cert             = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] driver_client_cert_key         = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] driver_data_namespace          = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] driver_ssl_cert_path           = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] driver_ssl_cert_verify         = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75394]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] driver_use_ssl                 = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] enable_force_upload            = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] enable_new_services            = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] enable_unsupported_driver      = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] enforce_multipath_for_image_xfer = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] filter_function                = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance_api_insecure            = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance_api_servers             = ['http://192.168.122.127/image'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance_api_ssl_compression     = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance_ca_certificates_file    = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance_catalog_info            = image:glance:publicURL {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance_certfile                = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance_keyfile                 = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance_num_retries             = 3 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance_request_timeout         = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] goodness_function              = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] graceful_shutdown_timeout      = 5 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] group_api_class                = cinder.group.api.API {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] host                           = devstack {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] image_compress_on_upload       = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] image_conversion_address_space_limit = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] image_conversion_cpu_limit     = 60 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] image_conversion_disable       = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] image_introspection_address_space_limit = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] image_introspection_cpu_limit  = 60 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] image_upload_use_cinder_backend = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] image_upload_use_internal_tenant = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] image_volume_cache_enabled     = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] image_volume_cache_max_count   = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] image_volume_cache_max_size_gb = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] init_host_max_objects_retrieval = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] instance_format                = [instance: %(uuid)s]  {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] iscsi_target_flags             =  {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] iscsi_write_cache              = on {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] iser_helper                    = tgtadm {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] iser_ip_address                = 192.168.122.127 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] iser_port                      = 3260 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] log_color                      = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] log_config_append              = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] log_dir                        = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] log_file                       = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] log_options                    = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:55 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] log_rotate_interval            = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] log_rotate_interval_type       = days {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] log_rotation_type              = none {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] max_age                        = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] max_logfile_count              = 30 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] max_logfile_size_mb            = 200 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] max_over_subscription_ratio    = 20.0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] message_reap_interval          = 86400 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] message_ttl                    = 2592000 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] migration_create_volume_timeout_secs = 300 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] monkey_patch                   = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] monkey_patch_modules           = [] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] my_ip                          = 192.168.122.127 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] no_snapshot_gb_quota           = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] num_iser_scan_tries            = 3 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] num_shell_tries                = 3 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] num_volume_device_scan_tries   = 3 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] nvmeof_conn_info_version       = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] nvmet_ns_id                    = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] nvmet_port_id                  = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] osapi_max_limit                = 1000 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] osapi_volume_ext_list          = [] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] osapi_volume_listen_port       = 8776 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] osapi_volume_use_ssl           = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] osapi_volume_workers           = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] per_volume_size_limit          = -1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] periodic_fuzzy_delay           = 60 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] periodic_interval              = 60 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] public_endpoint                = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] publish_errors                 = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] quota_backup_gigabytes         = 1000 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] quota_backups                  = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] quota_gigabytes                = 1000 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] quota_groups                   = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] quota_snapshots                = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] quota_volumes                  = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75394]: INFO cinder.volume.manager [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] rate_limit_burst               = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] rate_limit_except_level        = CRITICAL {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] rate_limit_interval            = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] reinit_driver_count            = 3 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] replication_device             = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] report_discard_supported       = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] report_interval                = 120 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] reservation_clean_interval     = 86400 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] reservation_expire             = 86400 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] reserved_image_namespaces      = [] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] reserved_percentage            = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] rpc_response_timeout           = 120 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] run_external_periodic_tasks    = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] scst_target_driver             = iscsi {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] scst_target_iqn_name           = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_down_time              = 720 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] shell_completion               = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] snapshot_name_template         = snapshot-%s {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] snapshot_same_host             = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] split_loggers                  = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] state_path                     = /opt/stack/data/cinder {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] storage_availability_zone      = nova {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] storage_protocol               = iSCSI {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] syslog_log_facility            = LOG_USER {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] target_helper                  = lioadm {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] target_ip_address              = 192.168.122.127 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] target_port                    = 3260 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] target_protocol                = iscsi {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] target_secondary_ip_addresses  = [] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] trace_flags                    = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] transport_url                  = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] until_refresh                  = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] use_chap_auth                  = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] use_default_quota_class        = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] use_journal                    = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] use_json                       = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] use_multipath_for_image_xfer   = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] use_stderr                     = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] use_syslog                     = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] verify_glance_signatures       = enabled {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volume_api_class               = cinder.volume.api.API {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volume_backend_name            = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volume_clear                   = zero {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volume_clear_ionice            = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volume_clear_size              = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volume_copy_bps_limit          = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volume_dd_blocksize            = 1M {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volume_name_template           = volume-%s {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volume_service_inithost_offload = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volume_usage_audit_period      = month {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] zoning_mode                    = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_concurrency.disable_process_locking = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.auth_section = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.auth_type   = password {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.auth_version = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.cache       = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.certfile    = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.include_service_catalog = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.insecure    = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.interface   = public {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.keyfile     = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_password = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcache_username = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.region_name = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.service_type = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.127/identity {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.backend                  = dogpile.cache.null {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.backend_argument         = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.backend_expiration_time  = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.config_prefix            = cache.oslo {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.debug_cache_backend      = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.enable_retry_client      = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.enable_socket_keepalive  = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.enabled                  = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.expiration_time          = 600 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.hashclient_retry_attempts = 2 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.memcache_dead_retry      = 300 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.memcache_pool_maxsize    = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.memcache_sasl_enabled    = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.password                 = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.proxies                  = [] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.redis_db                 = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.redis_server             = localhost:6379 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.retry_attempts           = 2 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.retry_delay              = 0.0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.socket_keepalive_count   = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.socket_keepalive_idle    = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.socket_keepalive_interval = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.socket_timeout           = 1.0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.tls_allowed_ciphers      = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.tls_cafile               = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.tls_certfile             = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.tls_enabled              = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.tls_keyfile              = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cache.username                 = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] coordination.backend_url       = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.asyncio_connection    = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.asyncio_slave_connection = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.backend               = sqlalchemy {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.connection            = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.connection_debug      = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.connection_parameters =  {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.connection_recycle_time = 3600 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.connection_trace      = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.db_inc_retry_interval = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.db_max_retries        = 20 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.db_max_retry_interval = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.db_retry_interval     = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.max_overflow          = 50 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.max_pool_size         = 5 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.max_retries           = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.mysql_wsrep_sync_wait = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.pool_timeout          = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.retry_interval        = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.slave_connection      = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.sqlite_synchronous    = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.synchronous_reader    = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] database.use_db_reconnect      = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_tracing.insecure = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler.connection_string     = messaging:// {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler.enabled               = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler.es_doc_type           = notification {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler.es_scroll_size        = 10000 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler.es_scroll_time        = 2m {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler.filter_error_trace    = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler.hmac_keys             = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler.sentinel_service_name = mymaster {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler.socket_timeout        = 0.1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler.trace_requests        = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler.trace_sqlalchemy      = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler_jaeger.process_tags   = {} {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler_jaeger.service_name_prefix = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] profiler_otlp.service_name_prefix = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_policy.enforce_new_defaults = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_policy.policy_default_rule = default {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_policy.policy_file        = policy.yaml {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] privsep_osbrick.group          = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] privsep_osbrick.helper_command = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] privsep_osbrick.user           = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cinder_sys_admin.group         = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cinder_sys_admin.helper_command = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] cinder_sys_admin.user          = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_user.auth_section      = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_user.auth_type         = password {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_user.cafile            = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_user.certfile          = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_user.collect_timing    = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_user.insecure          = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_user.keyfile           = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_user.send_service_user_token = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_user.split_loggers     = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_user.timeout           = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_user.tls_ciphers       = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] service_user.tls_min_version   = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance.auth_section            = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance.auth_type               = password {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance.certfile                = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance.collect_timing          = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance.insecure                = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance.keyfile                 = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance.region_name             = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance.split_loggers           = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance.timeout                 = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance.tls_ciphers             = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] glance.tls_min_version         = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.backend_availability_zone = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.chap_password = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.chap_username =  {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.disk_geometry = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.driver_client_cert = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.driver_client_cert_key = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.driver_data_namespace = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.driver_use_ssl = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.extra_capabilities = {} {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.filter_function = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.goodness_function = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.iscsi_target_flags =  {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.iscsi_write_cache = on {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.iser_helper   = tgtadm {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.iser_ip_address = 192.168.122.127 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.iser_port     = 3260 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.lvm_share_target = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.lvm_type      = auto {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.num_shell_tries = 3 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.replication_device = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.report_discard_supported = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.reserved_percentage = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.target_helper = tgtadm {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.target_ip_address = 192.168.122.127 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.target_port   = 3260 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.target_protocol = iscsi {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.trace_flags   = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.unique_fqdn_network = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.use_chap_auth = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.volume_backend_name = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.volume_clear  = zero {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.volume_clear_ionice = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.volume_clear_size = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_reports.file_event_handler = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_reports.log_dir           = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.backend_host       = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.chap_password      = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.chap_username      = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.disk_geometry      = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.driver_client_cert = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.extra_capabilities = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.filter_function    = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.goodness_function  = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.iser_helper        = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.iser_ip_address    = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.iser_port          = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.lvm_share_target   = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.lvm_type           = auto {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.num_shell_tries    = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack sudo[75402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.replication_device = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.report_discard_supported = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.reserved_percentage = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.scst_target_driver = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack sudo[75402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.storage_protocol   = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.target_helper      = lioadm {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.target_ip_address  = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.target_port        = 3260 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.trace_flags        = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.use_chap_auth      = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.volume_clear       = zero {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.volume_clear_size  = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] lvmdriver-1.volumes_dir        = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.ssl      = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_notifications.driver = [] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_notifications.retry = -1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] key_manager.fixed_key          = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.barbican_api_version  = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.barbican_endpoint     = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.barbican_endpoint_type = public {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.barbican_region_name  = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.cafile                = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.certfile              = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.collect_timing        = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.insecure              = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.keyfile               = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.number_of_retries     = 60 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.retry_delay           = 1 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.send_service_user_token = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.split_loggers         = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.timeout               = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.tls_ciphers           = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.tls_min_version       = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.verify_ssl            = True {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican.verify_ssl_path       = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican_service_user.auth_section = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican_service_user.auth_type = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican_service_user.cafile   = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican_service_user.certfile = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican_service_user.collect_timing = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican_service_user.insecure = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican_service_user.keyfile  = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican_service_user.split_loggers = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican_service_user.timeout  = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican_service_user.tls_ciphers = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] barbican_service_user.tls_min_version = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.approle_role_id          = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.approle_secret_id        = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.auth_method              = approle {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.auth_path                = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.kv_mountpoint            = secret {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.kv_path                  = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.kv_version               = 2 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.namespace                = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.root_token_id            = **** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.ssl_ca_crt_file          = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.timeout                  = 60.0 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.token_file               = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.token_role               = None {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.use_ssl                  = False {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:28:56 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] ******************************************************************************** {{(pid=75251) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 16 08:28:56 devstack sudo[75402]: pam_unix(sudo:session): session closed for user root
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:56 devstack sudo[75408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:28:56 devstack sudo[75408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:28:56 devstack sudo[75408]: pam_unix(sudo:session): session closed for user root
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.246s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:28:56 devstack cinder-volume[75394]: INFO cinder.brick.local_dev.lvm [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:56 devstack sudo[75488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 08:28:56 devstack sudo[75488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:28:56 devstack sudo[75488]: pam_unix(sudo:session): session closed for user root
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG cinder.brick.local_dev.lvm [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75394) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 16 08:28:56 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:57 devstack sudo[75600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:28:57 devstack sudo[75600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:28:57 devstack sudo[75600]: pam_unix(sudo:session): session closed for user root
Sep 16 08:28:57 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.512s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:57 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:57 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:57 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:57 devstack sudo[75783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:28:57 devstack sudo[75783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:28:57 devstack sudo[75783]: pam_unix(sudo:session): session closed for user root
Sep 16 08:28:57 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:57 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:57 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:57 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:57 devstack sudo[75880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 16 08:28:57 devstack sudo[75880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:28:58 devstack sudo[75880]: pam_unix(sudo:session): session closed for user root
Sep 16 08:28:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.270s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:58 devstack sudo[75986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 08:28:58 devstack sudo[75986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:28:58 devstack sudo[75986]: pam_unix(sudo:session): session closed for user root
Sep 16 08:28:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:58 devstack sudo[76016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 08:28:58 devstack sudo[76016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:28:58 devstack sudo[76016]: pam_unix(sudo:session): session closed for user root
Sep 16 08:28:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:58 devstack sudo[76074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:28:58 devstack sudo[76074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:28:58 devstack sudo[76074]: pam_unix(sudo:session): session closed for user root
Sep 16 08:28:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:58 devstack sudo[76103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:28:58 devstack sudo[76103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:28:59 devstack sudo[76103]: pam_unix(sudo:session): session closed for user root
Sep 16 08:28:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:59 devstack sudo[76119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:28:59 devstack sudo[76119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:28:59 devstack sudo[76119]: pam_unix(sudo:session): session closed for user root
Sep 16 08:28:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.313s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:59 devstack cinder-volume[75394]: INFO cinder.volume.drivers.lvm [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 16 08:28:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:59 devstack sudo[76203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:28:59 devstack sudo[76203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:28:59 devstack sudo[76203]: pam_unix(sudo:session): session closed for user root
Sep 16 08:28:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:28:59 devstack cinder-volume[75394]: DEBUG cinder.volume.drivers.lvm [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Updating volume stats {{(pid=75394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 08:28:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:28:59 devstack sudo[76206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 08:28:59 devstack sudo[76206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:00 devstack sudo[76206]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:00 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:00 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:00 devstack sudo[76211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:29:00 devstack sudo[76211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:00 devstack sudo[76211]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:00 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:00 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:00 devstack sudo[76215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:29:00 devstack sudo[76215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:00 devstack sudo[76215]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:00 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:00 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:00 devstack sudo[76218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:29:00 devstack sudo[76218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:00 devstack sudo[76218]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:00 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:00 devstack cinder-volume[75394]: INFO cinder.volume.driver [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Driver hasn't implemented _init_vendor_properties()
Sep 16 08:29:00 devstack cinder-volume[75394]: DEBUG cinder.volume.driver [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75394) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 16 08:29:01 devstack cinder-volume[75394]: DEBUG oslo_db.sqlalchemy.engines [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75394) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:29:01 devstack cinder-volume[75394]: DEBUG dbcounter [-] [75394] Writer thread running {{(pid=75394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 08:29:01 devstack cinder-volume[75394]: DEBUG cinder.db.api [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Building query based on filter {{(pid=75394) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 16 08:29:01 devstack cinder-volume[75394]: DEBUG cinder.image.image_utils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75394) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 16 08:29:01 devstack cinder-volume[75394]: INFO cinder.keymgr.migration [None req-eb2c3bca-72bd-4fb3-9603-062b853e44d8 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 16 08:29:01 devstack cinder-volume[75394]: DEBUG cinder.volume.drivers.lvm [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Updating volume stats {{(pid=75394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 08:29:01 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:01 devstack sudo[76223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 08:29:01 devstack sudo[76223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:01 devstack sudo[76223]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:01 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:01 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:01 devstack sudo[76226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:29:01 devstack sudo[76226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:01 devstack sudo[76226]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:01 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:01 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:01 devstack sudo[76231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:29:01 devstack sudo[76231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:01 devstack sudo[76231]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:01 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:02 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:02 devstack sudo[76234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:29:02 devstack sudo[76234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:02 devstack sudo[76234]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:02 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:02 devstack cinder-volume[75394]: DEBUG cinder.manager [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Notifying Schedulers of capabilities ... {{(pid=75394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:29:02 devstack cinder-volume[75394]: INFO cinder.volume.manager [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Driver initialization completed successfully.
Sep 16 08:29:02 devstack cinder-volume[75394]: INFO cinder.manager [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Initiating service 2 cleanup
Sep 16 08:29:02 devstack cinder-volume[75394]: INFO cinder.manager [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Service 2 cleanup completed.
Sep 16 08:29:02 devstack cinder-volume[75394]: DEBUG cinder.service [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Creating RPC server for service cinder-volume {{(pid=75394) start /opt/stack/cinder/cinder/service.py:231}}
Sep 16 08:29:02 devstack cinder-volume[75394]: DEBUG cinder.service [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75394) start /opt/stack/cinder/cinder/service.py:237}}
Sep 16 08:29:02 devstack cinder-volume[75394]: INFO cinder.volume.manager [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 16 08:29:02 devstack cinder-volume[75394]: DEBUG cinder.volume.drivers.lvm [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Updating volume stats {{(pid=75394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 08:29:02 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:02 devstack sudo[76237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 08:29:02 devstack sudo[76237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:02 devstack sudo[76237]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:02 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:02 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:02 devstack sudo[76240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:29:02 devstack sudo[76240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:03 devstack sudo[76240]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:03 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:03 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:03 devstack sudo[76248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:29:03 devstack sudo[76248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:03 devstack sudo[76248]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:03 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:03 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:03 devstack sudo[76251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:29:03 devstack sudo[76251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:03 devstack sudo[76251]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:03 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:03 devstack cinder-volume[75394]: INFO cinder.volume.manager [None req-3a6036a1-273e-4e85-b108-405c823b237b None None] Driver post RPC initialization completed successfully.
Sep 16 08:29:05 devstack cinder-volume[75251]: DEBUG dbcounter [-] [75251] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75251) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:29:13 devstack cinder-volume[75394]: DEBUG dbcounter [-] [75394] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:29:13 devstack cinder-volume[75394]: DEBUG dbcounter [-] [75394] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:29:58 devstack cinder-volume[75394]: DEBUG oslo_service.periodic_task [None req-892a3716-8793-458c-95ba-21566210792a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:29:58 devstack cinder-volume[75394]: DEBUG cinder.volume.drivers.lvm [None req-892a3716-8793-458c-95ba-21566210792a None None] Updating volume stats {{(pid=75394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 08:29:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:58 devstack sudo[78224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 08:29:58 devstack sudo[78224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:58 devstack sudo[78224]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:58 devstack sudo[78227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:29:58 devstack sudo[78227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:59 devstack sudo[78227]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:59 devstack sudo[78230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:29:59 devstack sudo[78230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:59 devstack sudo[78230]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:29:59 devstack sudo[78233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:29:59 devstack sudo[78233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:29:59 devstack sudo[78233]: pam_unix(sudo:session): session closed for user root
Sep 16 08:29:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:29:59 devstack cinder-volume[75394]: DEBUG cinder.manager [None req-892a3716-8793-458c-95ba-21566210792a None None] Notifying Schedulers of capabilities ... {{(pid=75394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:29:59 devstack cinder-volume[75394]: DEBUG oslo_service.periodic_task [None req-892a3716-8793-458c-95ba-21566210792a None None] Running periodic task VolumeManager._thread_info {{(pid=75394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:29:59 devstack cinder-volume[75394]: DEBUG cinder.volume.manager [None req-892a3716-8793-458c-95ba-21566210792a None None] thread count: 6 {{(pid=75394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:29:59 devstack cinder-volume[75394]: DEBUG cinder.volume.manager [None req-892a3716-8793-458c-95ba-21566210792a None None] thread info: [<_MainThread(MainThread, started 132363840000128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132363726541120)>, <Thread(Thread-3 (stat_writer), started daemon 132363728564928)>, <Thread(Rabbit-heartbeat, started daemon 132363750651200)>, <Thread(Thread-5 (_runner), started daemon 132363724442176)>, <Thread(Thread-7 (_runner), started daemon 132363722496256)>] {{(pid=75394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:30:58 devstack cinder-volume[75394]: DEBUG oslo_service.periodic_task [None req-892a3716-8793-458c-95ba-21566210792a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:30:58 devstack cinder-volume[75394]: DEBUG cinder.volume.drivers.lvm [None req-892a3716-8793-458c-95ba-21566210792a None None] Updating volume stats {{(pid=75394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 08:30:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:30:58 devstack sudo[81532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 08:30:58 devstack sudo[81532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:30:58 devstack sudo[81532]: pam_unix(sudo:session): session closed for user root
Sep 16 08:30:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:30:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:30:58 devstack sudo[81535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:30:58 devstack sudo[81535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:30:59 devstack sudo[81535]: pam_unix(sudo:session): session closed for user root
Sep 16 08:30:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:30:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:30:59 devstack sudo[81538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:30:59 devstack sudo[81538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:30:59 devstack sudo[81538]: pam_unix(sudo:session): session closed for user root
Sep 16 08:30:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:30:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:30:59 devstack sudo[81542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:30:59 devstack sudo[81542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:30:59 devstack sudo[81542]: pam_unix(sudo:session): session closed for user root
Sep 16 08:30:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:30:59 devstack cinder-volume[75394]: DEBUG cinder.manager [None req-892a3716-8793-458c-95ba-21566210792a None None] Notifying Schedulers of capabilities ... {{(pid=75394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:30:59 devstack cinder-volume[75394]: DEBUG oslo_service.periodic_task [None req-892a3716-8793-458c-95ba-21566210792a None None] Running periodic task VolumeManager._thread_info {{(pid=75394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:30:59 devstack cinder-volume[75394]: DEBUG cinder.volume.manager [None req-892a3716-8793-458c-95ba-21566210792a None None] thread count: 6 {{(pid=75394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:30:59 devstack cinder-volume[75394]: DEBUG cinder.volume.manager [None req-892a3716-8793-458c-95ba-21566210792a None None] thread info: [<_MainThread(MainThread, started 132363840000128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132363726541120)>, <Thread(Thread-3 (stat_writer), started daemon 132363728564928)>, <Thread(Rabbit-heartbeat, started daemon 132363750651200)>, <Thread(Thread-5 (_runner), started daemon 132363724442176)>, <Thread(Thread-7 (_runner), started daemon 132363722496256)>] {{(pid=75394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:31:13 devstack cinder-volume[75394]: DEBUG dbcounter [-] [75394] Writing DB stats cinder:SELECT=1 {{(pid=75394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:31:13 devstack cinder-volume[75394]: DEBUG dbcounter [-] [75394] Writing DB stats cinder:UPDATE=1 {{(pid=75394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:31:58 devstack cinder-volume[75394]: DEBUG oslo_service.periodic_task [None req-892a3716-8793-458c-95ba-21566210792a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:31:58 devstack cinder-volume[75394]: DEBUG cinder.volume.drivers.lvm [None req-892a3716-8793-458c-95ba-21566210792a None None] Updating volume stats {{(pid=75394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 08:31:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:31:58 devstack sudo[83472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 08:31:58 devstack sudo[83472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:31:58 devstack sudo[83472]: pam_unix(sudo:session): session closed for user root
Sep 16 08:31:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:31:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:31:58 devstack sudo[83477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:31:58 devstack sudo[83477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:31:59 devstack sudo[83477]: pam_unix(sudo:session): session closed for user root
Sep 16 08:31:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:31:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:31:59 devstack sudo[83491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:31:59 devstack sudo[83491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:31:59 devstack sudo[83491]: pam_unix(sudo:session): session closed for user root
Sep 16 08:31:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:31:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:31:59 devstack sudo[83499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:31:59 devstack sudo[83499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:31:59 devstack sudo[83499]: pam_unix(sudo:session): session closed for user root
Sep 16 08:31:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:31:59 devstack cinder-volume[75394]: DEBUG cinder.manager [None req-892a3716-8793-458c-95ba-21566210792a None None] Notifying Schedulers of capabilities ... {{(pid=75394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:32:58 devstack cinder-volume[75394]: DEBUG oslo_service.periodic_task [None req-892a3716-8793-458c-95ba-21566210792a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:32:58 devstack cinder-volume[75394]: DEBUG cinder.volume.drivers.lvm [None req-892a3716-8793-458c-95ba-21566210792a None None] Updating volume stats {{(pid=75394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 08:32:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:32:58 devstack sudo[84818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 08:32:58 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:32:58 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root
Sep 16 08:32:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:32:58 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:32:58 devstack sudo[84821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:32:58 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:32:59 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root
Sep 16 08:32:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:32:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:32:59 devstack sudo[84827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 08:32:59 devstack sudo[84827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:32:59 devstack sudo[84827]: pam_unix(sudo:session): session closed for user root
Sep 16 08:32:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:32:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:32:59 devstack sudo[84830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 08:32:59 devstack sudo[84830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:32:59 devstack sudo[84830]: pam_unix(sudo:session): session closed for user root
Sep 16 08:32:59 devstack cinder-volume[75394]: DEBUG oslo_concurrency.processutils [None req-892a3716-8793-458c-95ba-21566210792a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75394) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:32:59 devstack cinder-volume[75394]: DEBUG cinder.manager [None req-892a3716-8793-458c-95ba-21566210792a None None] Notifying Schedulers of capabilities ... {{(pid=75394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:32:59 devstack cinder-volume[75394]: DEBUG oslo_service.periodic_task [None req-892a3716-8793-458c-95ba-21566210792a None None] Running periodic task VolumeManager._thread_info {{(pid=75394) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:32:59 devstack cinder-volume[75394]: DEBUG cinder.volume.manager [None req-892a3716-8793-458c-95ba-21566210792a None None] thread count: 6 {{(pid=75394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:32:59 devstack cinder-volume[75394]: DEBUG cinder.volume.manager [None req-892a3716-8793-458c-95ba-21566210792a None None] thread info: [<_MainThread(MainThread, started 132363840000128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132363726541120)>, <Thread(Thread-3 (stat_writer), started daemon 132363728564928)>, <Thread(Rabbit-heartbeat, started daemon 132363750651200)>, <Thread(Thread-5 (_runner), started daemon 132363724442176)>, <Thread(Thread-7 (_runner), started daemon 132363722496256)>] {{(pid=75394) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:33:13 devstack cinder-volume[75394]: DEBUG dbcounter [-] [75394] Writing DB stats cinder:SELECT=1 {{(pid=75394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:33:13 devstack cinder-volume[75394]: DEBUG dbcounter [-] [75394] Writing DB stats cinder:UPDATE=1 {{(pid=75394) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:33:22 devstack cinder-volume[75251]: INFO oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Caught SIGTERM, stopping children
Sep 16 08:33:22 devstack cinder-volume[75251]: DEBUG oslo_concurrency.lockutils [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Acquiring lock "singleton_lock" {{(pid=75251) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 08:33:22 devstack cinder-volume[75251]: DEBUG oslo_concurrency.lockutils [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Acquired lock "singleton_lock" {{(pid=75251) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 08:33:22 devstack cinder-volume[75251]: DEBUG oslo_concurrency.lockutils [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Releasing lock "singleton_lock" {{(pid=75251) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 08:33:22 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Stop services. {{(pid=75251) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 16 08:33:22 devstack cinder-volume[75251]: DEBUG oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Killing children. {{(pid=75251) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 16 08:33:22 devstack cinder-volume[75251]: INFO oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Waiting on 1 children to exit
Sep 16 08:33:22 devstack cinder-volume[75394]: DEBUG oslo_concurrency.lockutils [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Acquiring lock "singleton_lock" {{(pid=75394) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 08:33:22 devstack cinder-volume[75394]: DEBUG oslo_concurrency.lockutils [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Acquired lock "singleton_lock" {{(pid=75394) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 08:33:22 devstack cinder-volume[75394]: DEBUG oslo_concurrency.lockutils [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Releasing lock "singleton_lock" {{(pid=75394) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 08:33:22 devstack cinder-volume[75394]: WARNING amqp [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 08:33:22 devstack cinder-volume[75394]: WARNING amqp [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 08:33:22 devstack cinder-volume[75251]: INFO oslo_service.backend._eventlet.service [None req-5de433be-8fcb-446d-b3b4-b19109fe1b3b None None] Child 75394 exited with status 0
Sep 16 08:33:22 devstack cinder-volume[85398]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 16 08:33:22 devstack cinder-volume[85398]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 16 08:33:22 devstack cinder-volume[85398]: we strongly recommend against using it for new projects.
Sep 16 08:33:22 devstack cinder-volume[85398]: If you are already using Eventlet, we recommend migrating to a different
Sep 16 08:33:22 devstack cinder-volume[85398]: framework.  For more detail see
Sep 16 08:33:22 devstack cinder-volume[85398]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 16 08:33:22 devstack cinder-volume[85398]:   import eventlet  # noqa
Sep 16 08:33:24 devstack cinder-volume[85398]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 08:33:24 devstack cinder-volume[85398]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 08:33:24 devstack cinder-volume[85398]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 08:33:25 devstack cinder-volume[85398]: INFO dbcounter [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Registered counter for database cinder
Sep 16 08:33:25 devstack cinder-volume[85398]: DEBUG oslo_db.sqlalchemy.engines [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:33:25 devstack cinder-volume[85398]: DEBUG dbcounter [-] [85398] Writer thread running {{(pid=85398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 08:33:25 devstack cinder-volume[85398]: INFO cinder.rpc [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 16 08:33:25 devstack cinder-volume[85398]: INFO cinder.rpc [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 16 08:33:25 devstack cinder-volume[85398]: DEBUG oslo_db.sqlalchemy.engines [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:33:26 devstack cinder-volume[85398]: INFO cinder.volume.manager [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Determined volume DB was empty at startup.
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG cinder.volume.manager [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85398) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 16 08:33:26 devstack cinder-volume[85398]: INFO cinder.volume.manager [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 16 08:33:26 devstack cinder-volume[85398]: WARNING stevedore.named [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 08:33:26 devstack cinder-volume[85398]: WARNING castellan.key_manager [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 08:33:26 devstack cinder-volume[85398]: WARNING cinder.keymgr.conf_key_mgr [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 08:33:26 devstack cinder-volume[85398]: INFO cinder.volume.manager [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_db.sqlalchemy.engines [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:33:26 devstack cinder-volume[85398]: INFO oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Starting 1 workers
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Started child 85612 {{(pid=85398) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Full set of CONF: {{(pid=85398) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] ******************************************************************************** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Configuration options gathered from: {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] ================================================================================ {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] allow_availability_zone_fallback = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] allow_compression_on_image_upload = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] allowed_direct_url_schemes     = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] api_rate_limit                 = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] auth_strategy                  = keystone {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_availability_zone      = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_host                   = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85612]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_name                   = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_stats_polling_interval = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backup_api_class               = cinder.backup.api.API {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backup_name_template           = backup-%s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backup_use_same_host           = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backup_use_temp_snapshot       = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] chap_password                  = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] chap_username                  =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cinder_internal_tenant_project_id = a9b1a63a153448a48c5c0254ea035879 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cinder_internal_tenant_user_id = 747968c8c9fa4c738636a56479d7729a {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cluster                        = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] compression_format             = gzip {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] config_dir                     = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] config_source                  = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] control_exchange               = openstack {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] debug                          = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] default_availability_zone      = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] default_group_type             = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] default_volume_type            = QuobyteHD {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] disk_geometry                  = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] driver_client_cert             = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] driver_client_cert_key         = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] driver_data_namespace          = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] driver_ssl_cert_path           = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] driver_ssl_cert_verify         = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] driver_use_ssl                 = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] enable_new_services            = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] enable_unsupported_driver      = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] enforce_multipath_for_image_xfer = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] filter_function                = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance_api_insecure            = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance_api_servers             = ['http://192.168.122.127/image'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance_api_ssl_compression     = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance_ca_certificates_file    = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance_certfile                = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance_keyfile                 = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance_num_retries             = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance_request_timeout         = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] goodness_function              = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] graceful_shutdown_timeout      = 5 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] group_api_class                = cinder.group.api.API {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] host                           = devstack {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] image_compress_on_upload       = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] image_conversion_address_space_limit = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] image_conversion_cpu_limit     = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] image_conversion_disable       = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] image_introspection_address_space_limit = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] image_introspection_cpu_limit  = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] image_upload_use_cinder_backend = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] image_upload_use_internal_tenant = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] image_volume_cache_enabled     = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] image_volume_cache_max_count   = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] image_volume_cache_max_size_gb = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] init_host_max_objects_retrieval = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] iscsi_target_flags             =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] iscsi_write_cache              = on {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] iser_helper                    = tgtadm {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] iser_ip_address                = 192.168.122.127 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] iser_port                      = 3260 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] log_color                      = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] log_config_append              = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] log_dir                        = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] log_file                       = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] log_options                    = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] log_rotate_interval            = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] log_rotate_interval_type       = days {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] log_rotation_type              = none {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] max_age                        = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] max_logfile_count              = 30 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] max_logfile_size_mb            = 200 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] max_over_subscription_ratio    = 20.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] message_reap_interval          = 86400 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] message_ttl                    = 2592000 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] migration_create_volume_timeout_secs = 300 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] monkey_patch                   = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] monkey_patch_modules           = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] my_ip                          = 192.168.122.127 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] no_snapshot_gb_quota           = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] num_iser_scan_tries            = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] num_shell_tries                = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] num_volume_device_scan_tries   = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] nvmeof_conn_info_version       = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] nvmet_ns_id                    = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] nvmet_port_id                  = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] osapi_max_limit                = 1000 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] osapi_volume_ext_list          = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85612]: INFO cinder.volume.manager [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 16 08:33:26 devstack cinder-volume[85612]: DEBUG cinder.volume.drivers.remotefs [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85612) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] osapi_volume_listen_port       = 8776 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] osapi_volume_use_ssl           = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] osapi_volume_workers           = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] per_volume_size_limit          = -1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] periodic_fuzzy_delay           = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] periodic_interval              = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] public_endpoint                = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] publish_errors                 = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] quota_backup_gigabytes         = 1000 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] quota_backups                  = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] quota_gigabytes                = 1000 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] quota_groups                   = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] quota_snapshots                = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] quota_volumes                  = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] rate_limit_burst               = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] rate_limit_except_level        = CRITICAL {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] rate_limit_interval            = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] reinit_driver_count            = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] replication_device             = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] report_discard_supported       = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] report_interval                = 120 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] reservation_clean_interval     = 86400 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] reservation_expire             = 86400 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] reserved_image_namespaces      = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] reserved_percentage            = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] rpc_response_timeout           = 120 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] run_external_periodic_tasks    = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] scst_target_driver             = iscsi {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] scst_target_iqn_name           = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_down_time              = 720 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] shell_completion               = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] snapshot_name_template         = snapshot-%s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] split_loggers                  = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] state_path                     = /opt/stack/data/cinder {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] storage_availability_zone      = nova {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] storage_protocol               = iSCSI {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] syslog_log_facility            = LOG_USER {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] target_helper                  = lioadm {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] target_ip_address              = 192.168.122.127 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] target_port                    = 3260 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] target_protocol                = iscsi {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] target_secondary_ip_addresses  = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] trace_flags                    = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] transport_url                  = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] until_refresh                  = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] use_chap_auth                  = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] use_default_quota_class        = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] use_journal                    = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] use_json                       = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] use_multipath_for_image_xfer   = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] use_stderr                     = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] use_syslog                     = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] verify_glance_signatures       = enabled {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volume_api_class               = cinder.volume.api.API {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volume_backend_name            = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volume_clear                   = zero {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volume_clear_ionice            = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volume_clear_size              = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volume_copy_bps_limit          = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volume_dd_blocksize            = 1M {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volume_name_template           = volume-%s {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volume_service_inithost_offload = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volume_usage_audit_period      = month {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] zoning_mode                    = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_concurrency.disable_process_locking = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.auth_section = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.auth_type   = password {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.auth_version = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.cache       = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.certfile    = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.include_service_catalog = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.insecure    = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.interface   = public {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.keyfile     = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_password = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcache_username = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.region_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.service_type = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.127/identity {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.backend                  = dogpile.cache.null {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.backend_argument         = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.backend_expiration_time  = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.config_prefix            = cache.oslo {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.debug_cache_backend      = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.enable_retry_client      = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.enable_socket_keepalive  = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.enabled                  = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.expiration_time          = 600 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.hashclient_retry_attempts = 2 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.memcache_dead_retry      = 300 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.memcache_sasl_enabled    = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.password                 = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.proxies                  = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.redis_db                 = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.redis_server             = localhost:6379 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.retry_attempts           = 2 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.retry_delay              = 0.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.socket_keepalive_count   = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.socket_keepalive_idle    = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.socket_keepalive_interval = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.socket_timeout           = 1.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.tls_allowed_ciphers      = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.tls_cafile               = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.tls_certfile             = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.tls_enabled              = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.tls_keyfile              = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cache.username                 = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] coordination.backend_url       = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.asyncio_connection    = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.asyncio_slave_connection = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.backend               = sqlalchemy {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.connection            = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.connection_debug      = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.connection_parameters =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.connection_recycle_time = 3600 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.connection_trace      = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85612]: DEBUG cinder.volume.drivers.quobyte [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85612) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 16 08:33:26 devstack cinder-volume[85612]: WARNING cinder.volume.drivers.quobyte [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 16 08:33:26 devstack cinder-volume[85612]: WARNING cinder.volume.drivers.quobyte [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 16 08:33:26 devstack cinder-volume[85612]: DEBUG oslo_concurrency.processutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Running cmd (subprocess): mount.quobyte {{(pid=85612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.db_inc_retry_interval = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.db_max_retries        = 20 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.db_max_retry_interval = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.db_retry_interval     = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.max_overflow          = 50 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.max_pool_size         = 5 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.max_retries           = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.mysql_wsrep_sync_wait = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.pool_timeout          = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.retry_interval        = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.slave_connection      = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.sqlite_synchronous    = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.synchronous_reader    = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] database.use_db_reconnect      = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_tracing.insecure = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler.connection_string     = messaging:// {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler.enabled               = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler.es_doc_type           = notification {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler.es_scroll_size        = 10000 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler.es_scroll_time        = 2m {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler.filter_error_trace    = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler.hmac_keys             = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler.sentinel_service_name = mymaster {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler.socket_timeout        = 0.1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler.trace_requests        = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler.trace_sqlalchemy      = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler_jaeger.process_tags   = {} {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler_jaeger.service_name_prefix = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] profiler_otlp.service_name_prefix = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_policy.enforce_new_defaults = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_policy.policy_default_rule = default {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] privsep_osbrick.group          = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] privsep_osbrick.helper_command = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] privsep_osbrick.user           = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cinder_sys_admin.group         = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cinder_sys_admin.helper_command = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] cinder_sys_admin.user          = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_user.auth_section      = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_user.auth_type         = password {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_user.cafile            = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_user.certfile          = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_user.collect_timing    = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_user.insecure          = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_user.keyfile           = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_user.send_service_user_token = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_user.split_loggers     = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_user.timeout           = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_user.tls_ciphers       = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] service_user.tls_min_version   = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance.auth_section            = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance.auth_type               = password {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance.certfile                = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance.collect_timing          = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance.insecure                = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance.keyfile                 = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance.region_name             = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance.split_loggers           = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance.timeout                 = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance.tls_ciphers             = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] glance.tls_min_version         = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.backend_availability_zone = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.chap_password = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.chap_username =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.disk_geometry = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.driver_client_cert = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.driver_client_cert_key = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.driver_data_namespace = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.driver_use_ssl = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.extra_capabilities = {} {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.filter_function = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.goodness_function = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.iscsi_target_flags =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.iscsi_write_cache = on {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.iser_ip_address = 192.168.122.127 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.iser_port     = 3260 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nas_host      =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nas_login     = admin {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nas_mount_options = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nas_password  = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nas_private_key =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nas_share_path =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.num_shell_tries = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.quobyte_volume_url = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.replication_device = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.report_discard_supported = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.reserved_percentage = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.target_helper = tgtadm {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.target_ip_address = 192.168.122.127 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.target_port   = 3260 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.target_protocol = iscsi {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.trace_flags   = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.unique_fqdn_network = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.use_chap_auth = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.volume_backend_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.volume_clear  = zero {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.volume_clear_ionice = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.volume_clear_size = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_reports.file_event_handler = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_reports.log_dir           = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.backend_availability_zone = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.backend_host         = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.chap_password        = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.chap_username        = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.disk_geometry        = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.driver_client_cert   = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.driver_data_namespace = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.extra_capabilities   = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.filter_function      = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.goodness_function    = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.iser_helper          = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.iser_ip_address      = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.iser_port            = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nas_host             = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nas_login            = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nas_mount_options    = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nas_password         = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nas_private_key      = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nas_share_path       = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.num_shell_tries      = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.replication_device   = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.report_discard_supported = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.reserved_percentage  = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.scst_target_driver   = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.storage_protocol     = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.target_helper        = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.target_ip_address    = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.target_port          = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.target_prefix        = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.target_protocol      = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.trace_flags          = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.use_chap_auth        = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack quobyte-client[85613]: Reading configuration file: /etc/quobyte/client.cfg
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.volume_clear         = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.volume_clear_size    = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack quobyte-client[85613]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] QuobyteHD.volumes_dir          = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85612]: DEBUG oslo_concurrency.processutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] CMD "mount.quobyte" returned: 1 in 0.126s {{(pid=85612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85612]: DEBUG oslo_concurrency.lockutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85612]: DEBUG oslo_concurrency.lockutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_notifications.driver = [] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85612]: DEBUG cinder.volume.drivers.quobyte [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=85612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_notifications.retry = -1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85612]: INFO cinder.volume.drivers.quobyte [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 ...
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] key_manager.fixed_key          = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85612]: DEBUG oslo_concurrency.processutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 -c /etc/quobyte/client-cinder.cfg {{(pid=85612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.barbican_api_version  = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.barbican_endpoint     = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.barbican_endpoint_type = public {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.barbican_region_name  = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.cafile                = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.certfile              = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.collect_timing        = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.insecure              = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.keyfile               = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.number_of_retries     = 60 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.retry_delay           = 1 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.send_service_user_token = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.split_loggers         = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.timeout               = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.tls_ciphers           = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.tls_min_version       = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.verify_ssl            = True {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican.verify_ssl_path       = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican_service_user.auth_section = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican_service_user.auth_type = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican_service_user.cafile   = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican_service_user.certfile = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican_service_user.collect_timing = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican_service_user.insecure = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican_service_user.keyfile  = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican_service_user.split_loggers = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican_service_user.timeout  = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican_service_user.tls_ciphers = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] barbican_service_user.tls_min_version = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.approle_role_id          = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.approle_secret_id        = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.auth_method              = approle {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.auth_path                = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.kv_mountpoint            = secret {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.kv_path                  = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.kv_version               = 2 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.namespace                = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.root_token_id            = **** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.ssl_ca_crt_file          = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.timeout                  = 60.0 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.token_file               = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.token_role               = None {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.use_ssl                  = False {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:26 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] ******************************************************************************** {{(pid=85398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 16 08:33:26 devstack sudo[85618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 -c /etc/quobyte/client-cinder.cfg
Sep 16 08:33:26 devstack sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:33:26 devstack sudo[85618]: pam_unix(sudo:session): session closed for user root
Sep 16 08:33:26 devstack cinder-volume[85612]: DEBUG oslo_concurrency.processutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.407s {{(pid=85612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:33:26 devstack cinder-volume[85612]: INFO cinder.volume.drivers.quobyte [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 succeeded
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG cinder.volume.drivers.quobyte [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=85612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_concurrency.lockutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.439s {{(pid=85612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_concurrency.processutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=85612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:33:27 devstack sudo[85717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:33:27 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:33:27 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_concurrency.processutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.238s {{(pid=85612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:33:27 devstack cinder-volume[85612]: INFO cinder.volume.driver [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Driver hasn't implemented _init_vendor_properties()
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG cinder.volume.driver [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.93851852417, 'free_capacity_gb': 1775.93851852417, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85612) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_db.sqlalchemy.engines [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85612) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG dbcounter [-] [85612] Writer thread running {{(pid=85612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG cinder.db.api [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Building query based on filter {{(pid=85612) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG cinder.image.image_utils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85612) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 16 08:33:27 devstack cinder-volume[85612]: INFO cinder.keymgr.migration [None req-31ed0fe7-6348-43e0-8c28-41f6977230e0 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_concurrency.lockutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_concurrency.lockutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG cinder.volume.drivers.quobyte [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=85612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG cinder.volume.drivers.quobyte [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=85612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_concurrency.lockutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_concurrency.processutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=85612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:33:27 devstack sudo[85720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:33:27 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:33:27 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_concurrency.processutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.226s {{(pid=85612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG cinder.manager [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Notifying Schedulers of capabilities ... {{(pid=85612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:33:27 devstack cinder-volume[85612]: INFO cinder.volume.manager [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Driver initialization completed successfully.
Sep 16 08:33:27 devstack cinder-volume[85612]: INFO cinder.manager [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Initiating service 3 cleanup
Sep 16 08:33:27 devstack cinder-volume[85612]: INFO cinder.manager [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Service 3 cleanup completed.
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG cinder.service [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Creating RPC server for service cinder-volume {{(pid=85612) start /opt/stack/cinder/cinder/service.py:231}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG cinder.service [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85612) start /opt/stack/cinder/cinder/service.py:237}}
Sep 16 08:33:27 devstack cinder-volume[85612]: INFO cinder.volume.manager [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_concurrency.lockutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_concurrency.lockutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG cinder.volume.drivers.quobyte [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=85612) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG cinder.volume.drivers.quobyte [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=85612) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_concurrency.lockutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85612) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:33:27 devstack cinder-volume[85612]: DEBUG oslo_concurrency.processutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=85612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:33:27 devstack sudo[85723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:33:27 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:33:28 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root
Sep 16 08:33:28 devstack cinder-volume[85612]: DEBUG oslo_concurrency.processutils [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.266s {{(pid=85612) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:33:28 devstack cinder-volume[85612]: INFO cinder.volume.manager [None req-355c470d-5a78-479c-8874-33b26b4cfbc5 None None] Driver post RPC initialization completed successfully.
Sep 16 08:33:32 devstack cinder-volume[85398]: INFO oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Caught SIGTERM, stopping children
Sep 16 08:33:32 devstack cinder-volume[85398]: DEBUG oslo_concurrency.lockutils [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Acquiring lock "singleton_lock" {{(pid=85398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 08:33:32 devstack cinder-volume[85398]: DEBUG oslo_concurrency.lockutils [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Acquired lock "singleton_lock" {{(pid=85398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 08:33:32 devstack cinder-volume[85398]: DEBUG oslo_concurrency.lockutils [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Releasing lock "singleton_lock" {{(pid=85398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 08:33:32 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Stop services. {{(pid=85398) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 16 08:33:32 devstack cinder-volume[85398]: DEBUG oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Killing children. {{(pid=85398) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 16 08:33:32 devstack cinder-volume[85398]: INFO oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Waiting on 1 children to exit
Sep 16 08:33:36 devstack cinder-volume[85612]: DEBUG oslo_concurrency.lockutils [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Acquiring lock "singleton_lock" {{(pid=85612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 08:33:36 devstack cinder-volume[85612]: DEBUG oslo_concurrency.lockutils [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Acquired lock "singleton_lock" {{(pid=85612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 08:33:36 devstack cinder-volume[85612]: DEBUG oslo_concurrency.lockutils [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Releasing lock "singleton_lock" {{(pid=85612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 08:33:36 devstack cinder-volume[85612]: WARNING amqp [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 08:33:36 devstack cinder-volume[85612]: WARNING amqp [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 08:33:36 devstack cinder-volume[85398]: INFO oslo_service.backend._eventlet.service [None req-568fbef0-8a02-4102-b91b-3d6b88fef0a4 None None] Child 85612 exited with status 0
Sep 16 08:33:36 devstack cinder-volume[85962]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 16 08:33:36 devstack cinder-volume[85962]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 16 08:33:36 devstack cinder-volume[85962]: we strongly recommend against using it for new projects.
Sep 16 08:33:36 devstack cinder-volume[85962]: If you are already using Eventlet, we recommend migrating to a different
Sep 16 08:33:36 devstack cinder-volume[85962]: framework.  For more detail see
Sep 16 08:33:36 devstack cinder-volume[85962]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 16 08:33:36 devstack cinder-volume[85962]:   import eventlet  # noqa
Sep 16 08:33:39 devstack cinder-volume[85962]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85962) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 08:33:39 devstack cinder-volume[85962]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85962) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 08:33:39 devstack cinder-volume[85962]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85962) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 08:33:39 devstack cinder-volume[85962]: INFO dbcounter [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] Registered counter for database cinder
Sep 16 08:33:39 devstack cinder-volume[85962]: DEBUG oslo_db.sqlalchemy.engines [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85962) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG dbcounter [-] [85962] Writer thread running {{(pid=85962) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 08:33:40 devstack cinder-volume[85962]: INFO cinder.rpc [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 16 08:33:40 devstack cinder-volume[85962]: INFO cinder.rpc [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_db.sqlalchemy.engines [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85962) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:33:40 devstack cinder-volume[85962]: INFO cinder.volume.manager [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] Determined volume DB was empty at startup.
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG cinder.volume.manager [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85962) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 16 08:33:40 devstack cinder-volume[85962]: WARNING stevedore.named [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 08:33:40 devstack cinder-volume[85962]: WARNING castellan.key_manager [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 08:33:40 devstack cinder-volume[85962]: WARNING cinder.keymgr.conf_key_mgr [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 08:33:40 devstack cinder-volume[85962]: INFO cinder.volume.manager [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_db.sqlalchemy.engines [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85962) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:33:40 devstack cinder-volume[85962]: INFO oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] Starting 1 workers
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] Started child 86261 {{(pid=85962) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] Full set of CONF: {{(pid=85962) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] ******************************************************************************** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] Configuration options gathered from: {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 16 08:33:40 devstack cinder-volume[86261]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] ================================================================================ {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] allow_availability_zone_fallback = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] allow_compression_on_image_upload = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] allowed_direct_url_schemes     = [] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] api_rate_limit                 = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] auth_strategy                  = keystone {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_availability_zone      = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_host                   = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_name                   = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_stats_polling_interval = 60 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backup_api_class               = cinder.backup.api.API {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backup_name_template           = backup-%s {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backup_use_same_host           = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backup_use_temp_snapshot       = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] chap_password                  = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] chap_username                  =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cinder_internal_tenant_project_id = a9b1a63a153448a48c5c0254ea035879 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cinder_internal_tenant_user_id = 747968c8c9fa4c738636a56479d7729a {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cluster                        = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] compression_format             = gzip {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] config_dir                     = [] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] config_source                  = [] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] control_exchange               = openstack {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] debug                          = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] default_availability_zone      = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] default_group_type             = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] default_volume_type            = QuobyteHD {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] disk_geometry                  = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] driver_client_cert             = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] driver_client_cert_key         = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] driver_data_namespace          = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] driver_ssl_cert_path           = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] driver_ssl_cert_verify         = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] driver_use_ssl                 = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] enable_new_services            = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] enable_unsupported_driver      = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] enforce_multipath_for_image_xfer = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] filter_function                = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance_api_insecure            = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance_api_servers             = ['http://192.168.122.127/image'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance_api_ssl_compression     = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance_ca_certificates_file    = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance_certfile                = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance_keyfile                 = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance_num_retries             = 3 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance_request_timeout         = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] goodness_function              = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] graceful_shutdown_timeout      = 5 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] group_api_class                = cinder.group.api.API {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] host                           = devstack {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] image_compress_on_upload       = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] image_conversion_address_space_limit = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] image_conversion_cpu_limit     = 60 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86261) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] image_conversion_disable       = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] image_introspection_address_space_limit = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] image_introspection_cpu_limit  = 60 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] image_upload_use_cinder_backend = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] image_upload_use_internal_tenant = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] image_volume_cache_enabled     = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] image_volume_cache_max_count   = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] image_volume_cache_max_size_gb = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] init_host_max_objects_retrieval = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] iscsi_target_flags             =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] iscsi_write_cache              = on {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] iser_helper                    = tgtadm {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] iser_ip_address                = 192.168.122.127 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] iser_port                      = 3260 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] log_color                      = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] log_config_append              = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] log_dir                        = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] log_file                       = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] log_options                    = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] log_rotate_interval            = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] log_rotate_interval_type       = days {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] log_rotation_type              = none {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] max_age                        = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] max_logfile_count              = 30 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] max_logfile_size_mb            = 200 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] max_over_subscription_ratio    = 20.0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] message_reap_interval          = 86400 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] message_ttl                    = 2592000 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] migration_create_volume_timeout_secs = 300 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] monkey_patch                   = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] monkey_patch_modules           = [] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] my_ip                          = 192.168.122.127 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] no_snapshot_gb_quota           = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] num_iser_scan_tries            = 3 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] num_shell_tries                = 3 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] num_volume_device_scan_tries   = 3 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] nvmeof_conn_info_version       = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] nvmet_ns_id                    = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] nvmet_port_id                  = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] osapi_max_limit                = 1000 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] osapi_volume_ext_list          = [] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] osapi_volume_listen_port       = 8776 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] osapi_volume_use_ssl           = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] osapi_volume_workers           = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] per_volume_size_limit          = -1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] periodic_fuzzy_delay           = 60 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] periodic_interval              = 60 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] public_endpoint                = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] publish_errors                 = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] quota_backup_gigabytes         = 1000 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] quota_backups                  = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] quota_gigabytes                = 1000 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] quota_groups                   = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] quota_snapshots                = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] quota_volumes                  = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] rate_limit_burst               = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] rate_limit_except_level        = CRITICAL {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] rate_limit_interval            = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] reinit_driver_count            = 3 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] replication_device             = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] report_discard_supported       = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] report_interval                = 120 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] reservation_clean_interval     = 86400 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] reservation_expire             = 86400 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] reserved_image_namespaces      = [] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] reserved_percentage            = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] rpc_response_timeout           = 120 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] run_external_periodic_tasks    = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] scst_target_driver             = iscsi {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] scst_target_iqn_name           = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_down_time              = 720 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] shell_completion               = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] snapshot_name_template         = snapshot-%s {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] split_loggers                  = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] state_path                     = /opt/stack/data/cinder {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] storage_availability_zone      = nova {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] storage_protocol               = iSCSI {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] syslog_log_facility            = LOG_USER {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] target_helper                  = lioadm {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] target_ip_address              = 192.168.122.127 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] target_port                    = 3260 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] target_protocol                = iscsi {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] target_secondary_ip_addresses  = [] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] trace_flags                    = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] transport_url                  = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] until_refresh                  = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] use_chap_auth                  = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] use_default_quota_class        = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] use_journal                    = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] use_json                       = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] use_multipath_for_image_xfer   = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] use_stderr                     = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] use_syslog                     = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] verify_glance_signatures       = enabled {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volume_api_class               = cinder.volume.api.API {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volume_backend_name            = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volume_clear                   = zero {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volume_clear_ionice            = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volume_clear_size              = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volume_copy_bps_limit          = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volume_dd_blocksize            = 1M {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volume_name_template           = volume-%s {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volume_service_inithost_offload = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volume_usage_audit_period      = month {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] zoning_mode                    = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_concurrency.disable_process_locking = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.auth_section = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.auth_type   = password {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.auth_version = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.cache       = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86261) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.certfile    = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.quobyte [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.quobyte [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.include_service_catalog = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.insecure    = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.interface   = public {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Running cmd (subprocess): mount.quobyte {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.keyfile     = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_password = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcache_username = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.region_name = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.service_type = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.127/identity {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.backend                  = dogpile.cache.null {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.backend_argument         = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.backend_expiration_time  = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.config_prefix            = cache.oslo {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.debug_cache_backend      = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.enable_retry_client      = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.enable_socket_keepalive  = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.enabled                  = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.expiration_time          = 600 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.hashclient_retry_attempts = 2 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.memcache_dead_retry      = 300 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.memcache_sasl_enabled    = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.password                 = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.proxies                  = [] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.redis_db                 = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.redis_server             = localhost:6379 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.retry_attempts           = 2 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.retry_delay              = 0.0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.socket_keepalive_count   = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.socket_keepalive_idle    = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.socket_keepalive_interval = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.socket_timeout           = 1.0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.tls_allowed_ciphers      = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.tls_cafile               = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.tls_certfile             = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.tls_enabled              = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.tls_keyfile              = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cache.username                 = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] coordination.backend_url       = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.asyncio_connection    = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.asyncio_slave_connection = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.backend               = sqlalchemy {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.connection            = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.connection_debug      = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.connection_parameters =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.connection_recycle_time = 3600 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.connection_trace      = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.db_inc_retry_interval = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.db_max_retries        = 20 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.db_max_retry_interval = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.db_retry_interval     = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.max_overflow          = 50 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.max_pool_size         = 5 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.max_retries           = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.mysql_wsrep_sync_wait = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.pool_timeout          = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.retry_interval        = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.slave_connection      = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.sqlite_synchronous    = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.synchronous_reader    = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] database.use_db_reconnect      = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_tracing.insecure = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler.connection_string     = messaging:// {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler.enabled               = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler.es_doc_type           = notification {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler.es_scroll_size        = 10000 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler.es_scroll_time        = 2m {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler.filter_error_trace    = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler.hmac_keys             = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler.sentinel_service_name = mymaster {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler.socket_timeout        = 0.1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler.trace_requests        = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler.trace_sqlalchemy      = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler_jaeger.process_tags   = {} {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler_jaeger.service_name_prefix = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] profiler_otlp.service_name_prefix = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_policy.enforce_new_defaults = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_policy.policy_default_rule = default {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] privsep_osbrick.group          = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] privsep_osbrick.helper_command = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] privsep_osbrick.user           = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack quobyte-client[86262]: Reading configuration file: /etc/quobyte/client.cfg
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cinder_sys_admin.group         = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cinder_sys_admin.helper_command = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack quobyte-client[86262]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] cinder_sys_admin.user          = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_user.auth_section      = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_user.auth_type         = password {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_user.cafile            = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_user.certfile          = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_user.collect_timing    = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_user.insecure          = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_user.keyfile           = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_user.send_service_user_token = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_user.split_loggers     = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_user.timeout           = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_user.tls_ciphers       = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] service_user.tls_min_version   = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance.auth_section            = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance.auth_type               = password {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance.certfile                = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance.collect_timing          = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance.insecure                = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance.keyfile                 = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance.region_name             = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance.split_loggers           = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance.timeout                 = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance.tls_ciphers             = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] glance.tls_min_version         = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.backend_availability_zone = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.chap_password = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.chap_username =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.disk_geometry = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.driver_client_cert = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.driver_client_cert_key = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.driver_data_namespace = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.driver_use_ssl = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.extra_capabilities = {} {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.filter_function = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.goodness_function = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.iscsi_target_flags =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.iscsi_write_cache = on {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.iser_ip_address = 192.168.122.127 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.iser_port     = 3260 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nas_host      =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nas_login     = admin {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nas_mount_options = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nas_password  = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nas_private_key =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nas_share_path =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.num_shell_tries = 3 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.quobyte_volume_url = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.replication_device = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.report_discard_supported = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.reserved_percentage = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.target_helper = tgtadm {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.target_ip_address = 192.168.122.127 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.target_port   = 3260 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.target_protocol = iscsi {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.trace_flags   = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.unique_fqdn_network = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.use_chap_auth = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.volume_backend_name = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.volume_clear  = zero {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.volume_clear_ionice = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.volume_clear_size = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_reports.file_event_handler = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_reports.log_dir           = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.backend_availability_zone = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.backend_host         = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.chap_password        = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.chap_username        = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.disk_geometry        = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.driver_client_cert   = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.driver_data_namespace = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.extra_capabilities   = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.filter_function      = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.goodness_function    = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.iser_helper          = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.iser_ip_address      = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.iser_port            = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nas_host             = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nas_login            = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nas_mount_options    = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nas_password         = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nas_private_key      = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nas_share_path       = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.num_shell_tries      = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.replication_device   = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.report_discard_supported = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.reserved_percentage  = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.scst_target_driver   = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.storage_protocol     = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.target_helper        = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.target_ip_address    = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack sudo[86269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.target_port          = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.target_prefix        = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.target_protocol      = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.trace_flags          = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.use_chap_auth        = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.volume_clear         = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.volume_clear_size    = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] QuobyteHD.volumes_dir          = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_notifications.driver = [] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_notifications.retry = -1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] key_manager.fixed_key          = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.barbican_api_version  = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.barbican_endpoint     = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.barbican_endpoint_type = public {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.barbican_region_name  = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.cafile                = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.certfile              = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.collect_timing        = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.insecure              = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.keyfile               = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.number_of_retries     = 60 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.retry_delay           = 1 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.send_service_user_token = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.split_loggers         = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.timeout               = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.tls_ciphers           = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.tls_min_version       = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.verify_ssl            = True {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican.verify_ssl_path       = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican_service_user.auth_section = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican_service_user.auth_type = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican_service_user.cafile   = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican_service_user.certfile = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican_service_user.collect_timing = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican_service_user.insecure = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican_service_user.keyfile  = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican_service_user.split_loggers = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican_service_user.timeout  = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican_service_user.tls_ciphers = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] barbican_service_user.tls_min_version = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.approle_role_id          = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.approle_secret_id        = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.auth_method              = approle {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.auth_path                = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.kv_mountpoint            = secret {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.kv_path                  = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.kv_version               = 2 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.namespace                = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.root_token_id            = **** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.ssl_ca_crt_file          = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.timeout                  = 60.0 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.token_file               = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.token_role               = None {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.use_ssl                  = False {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 08:33:40 devstack cinder-volume[85962]: DEBUG oslo_service.backend._eventlet.service [None req-9dc0f9f8-776b-4c86-9342-491503e9ede2 None None] ******************************************************************************** {{(pid=85962) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 16 08:33:40 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.289s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:33:40 devstack cinder-volume[86261]: INFO cinder.volume.driver [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Driver hasn't implemented _init_vendor_properties()
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG cinder.volume.driver [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.93851852417, 'free_capacity_gb': 1775.93851852417, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86261) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG oslo_db.sqlalchemy.engines [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86261) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writer thread running {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG cinder.db.api [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Building query based on filter {{(pid=86261) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86261) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:33:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:33:40 devstack cinder-volume[86261]: INFO cinder.keymgr.migration [None req-40d45312-66c2-4852-bd59-ef4b370969d6 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 16 08:33:40 devstack sudo[86286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:33:40 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:33:41 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root
Sep 16 08:33:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.228s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:33:41 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:33:41 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Driver initialization completed successfully.
Sep 16 08:33:41 devstack cinder-volume[86261]: INFO cinder.manager [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Initiating service 3 cleanup
Sep 16 08:33:41 devstack cinder-volume[86261]: INFO cinder.manager [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Service 3 cleanup completed.
Sep 16 08:33:41 devstack cinder-volume[86261]: DEBUG cinder.service [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Creating RPC server for service cinder-volume {{(pid=86261) start /opt/stack/cinder/cinder/service.py:231}}
Sep 16 08:33:41 devstack cinder-volume[86261]: DEBUG cinder.service [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86261) start /opt/stack/cinder/cinder/service.py:237}}
Sep 16 08:33:41 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 16 08:33:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:33:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:33:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:33:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:33:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:33:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:33:41 devstack sudo[86292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:33:41 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:33:41 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root
Sep 16 08:33:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.252s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:33:41 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a92570f8-0993-455b-a7db-5e73fde7d24e None None] Driver post RPC initialization completed successfully.
Sep 16 08:33:50 devstack cinder-volume[85962]: DEBUG dbcounter [-] [85962] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85962) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:33:50 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:33:51 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=4 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:34:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:34:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 6 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:34:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:34:50 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Flow 'volume_create_manager' (a03c495c-3d74-4564-bcae-86b670015b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e544bb4-8264-485e-af6d-3841f87f271b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e544bb4-8264-485e-af6d-3841f87f271b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1786915659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5126ed-409d-4b18-89e4-43449943c616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5a1567d6db4dcc8bf84cbdeec96243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:34:51Z,use_quota=True,user_id='17fd2cd487be4054ab0b434bed87176c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b275367a-d32a-41fa-b78d-792fbb3f6349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b275367a-d32a-41fa-b78d-792fbb3f6349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a68f13-adb2-4219-9922-c372e7086ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a68f13-adb2-4219-9922-c372e7086ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5126ed-409d-4b18-89e4-43449943c616', 'volume_name': 'volume-eb5126ed-409d-4b18-89e4-43449943c616', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59f151c-2376-4064-8359-b46871a92f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59f151c-2376-4064-8359-b46871a92f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39a7f56-a511-4172-9925-e4af327b0985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:34:51 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Volume eb5126ed-409d-4b18-89e4-43449943c616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5126ed-409d-4b18-89e4-43449943c616', 'volume_size': 1}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1786915659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5126ed-409d-4b18-89e4-43449943c616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5a1567d6db4dcc8bf84cbdeec96243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:34:51Z,use_quota=True,user_id='17fd2cd487be4054ab0b434bed87176c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Creating volume eb5126ed-409d-4b18-89e4-43449943c616 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:34:51 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:34:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-eb5126ed-409d-4b18-89e4-43449943c616 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:34:51 devstack sudo[86976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-eb5126ed-409d-4b18-89e4-43449943c616 1073741824
Sep 16 08:34:51 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:34:52 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root
Sep 16 08:34:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-eb5126ed-409d-4b18-89e4-43449943c616 1073741824" returned: 0 in 1.458s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:34:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-eb5126ed-409d-4b18-89e4-43449943c616 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:34:53 devstack sudo[87317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-eb5126ed-409d-4b18-89e4-43449943c616
Sep 16 08:34:53 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:34:53 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root
Sep 16 08:34:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-eb5126ed-409d-4b18-89e4-43449943c616" returned: 0 in 0.708s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:34:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:34:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:34:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39a7f56-a511-4172-9925-e4af327b0985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5126ed-409d-4b18-89e4-43449943c616', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:34:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cdadfb-eb34-4cbe-ad9b-dc694a081913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:34:53 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Volume volume-eb5126ed-409d-4b18-89e4-43449943c616 (eb5126ed-409d-4b18-89e4-43449943c616): created successfully
Sep 16 08:34:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cdadfb-eb34-4cbe-ad9b-dc694a081913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:34:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Flow 'volume_create_manager' (a03c495c-3d74-4564-bcae-86b670015b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:34:53 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3d0541ad-a0b7-4756-92e1-05df6890be75 tempest-DeleteServersTestJSON-48758695 None] Created volume successfully.
Sep 16 08:35:02 devstack cinder-volume[86261]: WARNING py.warnings [req-cafa24c5-f2d5-42f9-9eb0-d601d142f58c req-e30a5394-2c5d-4885-9e4b-3df64b6db7be tempest-DeleteServersTestJSON-48758695 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Sep 16 08:35:02 devstack cinder-volume[86261]:   .first()
Sep 16 08:35:02 devstack cinder-volume[86261]: 
Sep 16 08:35:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-cafa24c5-f2d5-42f9-9eb0-d601d142f58c req-e30a5394-2c5d-4885-9e4b-3df64b6db7be tempest-DeleteServersTestJSON-48758695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-cafa24c5-f2d5-42f9-9eb0-d601d142f58c req-e30a5394-2c5d-4885-9e4b-3df64b6db7be tempest-DeleteServersTestJSON-48758695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-cafa24c5-f2d5-42f9-9eb0-d601d142f58c req-e30a5394-2c5d-4885-9e4b-3df64b6db7be tempest-DeleteServersTestJSON-48758695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-cafa24c5-f2d5-42f9-9eb0-d601d142f58c req-e30a5394-2c5d-4885-9e4b-3df64b6db7be tempest-DeleteServersTestJSON-48758695 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-eb5126ed-409d-4b18-89e4-43449943c616', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e034b9ae-c67e-44d0-9b67-22eb15c45a17', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:35:02 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-cafa24c5-f2d5-42f9-9eb0-d601d142f58c req-e30a5394-2c5d-4885-9e4b-3df64b6db7be tempest-DeleteServersTestJSON-48758695 None] attachment_update completed successfully.
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Flow 'volume_create_manager' (73a30a3d-6887-4b36-9690-7c8864a18eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (838bc862-2dd1-4567-8ea3-9e58b18deab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (838bc862-2dd1-4567-8ea3-9e58b18deab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2129257060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ff0cd4-2969-42e3-93d9-b80133ad20e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcfb8c5bad249bc9d2c718c89f13142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:35:06Z,use_quota=True,user_id='86f1662aa1b746ba87faff8883fad959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be065c3-2267-48f3-8b31-702f1f99acab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be065c3-2267-48f3-8b31-702f1f99acab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0295f007-0f6b-483a-b035-e256f84bd72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0295f007-0f6b-483a-b035-e256f84bd72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ff0cd4-2969-42e3-93d9-b80133ad20e2', 'volume_name': 'volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fed19e-0d32-490a-b0c4-dc1bd505648c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fed19e-0d32-490a-b0c4-dc1bd505648c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b24771d-b81e-4b29-a77e-3214c7a820bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:05 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Volume e8ff0cd4-2969-42e3-93d9-b80133ad20e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2', 'volume_size': 1}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2129257060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ff0cd4-2969-42e3-93d9-b80133ad20e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcfb8c5bad249bc9d2c718c89f13142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:35:06Z,use_quota=True,user_id='86f1662aa1b746ba87faff8883fad959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Creating volume e8ff0cd4-2969-42e3-93d9-b80133ad20e2 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:35:05 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:35:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:06 devstack sudo[87898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2 1073741824
Sep 16 08:35:06 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:07 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2 1073741824" returned: 0 in 1.702s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:07 devstack sudo[88006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2
Sep 16 08:35:07 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:08 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2" returned: 0 in 0.649s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] <== create_volume: return (2507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:35:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.516s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b24771d-b81e-4b29-a77e-3214c7a820bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d483c3a-70d4-429e-bcf3-35218b8a2a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:08 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Volume volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2 (e8ff0cd4-2969-42e3-93d9-b80133ad20e2): created successfully
Sep 16 08:35:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d483c3a-70d4-429e-bcf3-35218b8a2a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Flow 'volume_create_manager' (73a30a3d-6887-4b36-9690-7c8864a18eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:35:08 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-35b4761f-c228-4069-ba80-42513f11367b tempest-VolumesAdminNegativeTest-282479623 None] Created volume successfully.
Sep 16 08:35:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Acquiring lock "cinder-e8ff0cd4-2969-42e3-93d9-b80133ad20e2-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:35:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Lock "cinder-e8ff0cd4-2969-42e3-93d9-b80133ad20e2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:35:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Acquiring lock "cinder-quobyte-e8ff0cd4-2969-42e3-93d9-b80133ad20e2" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:35:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Lock "cinder-quobyte-e8ff0cd4-2969-42e3-93d9-b80133ad20e2" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:35:10 devstack cinder-volume[86261]: INFO oslo.privsep.daemon [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpg4nod9u7/privsep.sock']
Sep 16 08:35:10 devstack sudo[88016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpg4nod9u7/privsep.sock
Sep 16 08:35:10 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:12 devstack cinder-volume[86261]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 16 08:35:12 devstack cinder-volume[86261]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 16 08:35:12 devstack cinder-volume[86261]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 16 08:35:12 devstack cinder-volume[86261]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 16 08:35:12 devstack cinder-volume[86261]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 16 08:35:12 devstack cinder-volume[86261]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 16 08:35:12 devstack cinder-volume[86261]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 16 08:35:12 devstack cinder-volume[86261]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 16 08:35:12 devstack cinder-volume[86261]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 16 08:35:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:35:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:35:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:35:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:12 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-9bbc6669-5edb-4fd2-b159-a08a905ea826 req-5bc08b57-41dc-4ae3-a0f4-3d897c88d7ff tempest-DeleteServersTestJSON-48758695 None] Terminate volume connection completed successfully.
Sep 16 08:35:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-9bbc6669-5edb-4fd2-b159-a08a905ea826 req-5bc08b57-41dc-4ae3-a0f4-3d897c88d7ff tempest-DeleteServersTestJSON-48758695 None] Deleting attachment e034b9ae-c67e-44d0-9b67-22eb15c45a17. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:35:12 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:35:12 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:13 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:13 devstack cinder-volume[86261]: INFO oslo.privsep.daemon [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Spawned new privsep daemon via rootwrap
Sep 16 08:35:13 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Accepted privsep connection to /tmp/tmpg4nod9u7/privsep.sock {{(pid=86261) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 16 08:35:13 devstack cinder-volume[86261]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 16 08:35:13 devstack cinder-volume[86261]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 16 08:35:13 devstack cinder-volume[86261]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 16 08:35:13 devstack cinder-volume[86261]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88024
Sep 16 08:35:13 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e741c3-47ed-4fc4-9c89-a421700815c8]: (2,) {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:35:13 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[40caa4a9-9641-4ee0-a988-e8e248a2bb59]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:35:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:13 devstack sudo[88029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2
Sep 16 08:35:13 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:13 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.926s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:35:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:35:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 8 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:35:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:35:13 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2" returned: 0 in 0.596s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:14 devstack sudo[88034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2
Sep 16 08:35:14 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:14 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e8ff0cd4-2969-42e3-93d9-b80133ad20e2" returned: 0 in 0.767s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Lock "cinder-quobyte-e8ff0cd4-2969-42e3-93d9-b80133ad20e2" released by "delete_volume" :: held 4.359s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:35:15 devstack cinder-volume[86261]: WARNING cinder.quota [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:35:15 devstack cinder-volume[86261]: WARNING cinder.quota [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:35:15 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Created reservations ['9456c621-7dee-4274-9182-89de5b5b1489', 'd732aa3c-224e-4e05-8986-c45f9bba3544', 'c546314d-a8a5-4c80-a03d-d70f6acca3e9', '2394bd2d-db56-48a7-8ebf-1d68943e7483'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:35:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:35:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:35:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:15 devstack sudo[88070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:35:15 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:16 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.602s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:16 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:35:16 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Deleted volume successfully.
Sep 16 08:35:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1cf0c32d-1141-4223-a7a3-9402e5134120 tempest-VolumesAdminNegativeTest-282479623 None] Lock "cinder-e8ff0cd4-2969-42e3-93d9-b80133ad20e2-delete_volume" released by "delete_volume" :: held 5.721s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:35:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Acquiring lock "cinder-eb5126ed-409d-4b18-89e4-43449943c616-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:35:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Lock "cinder-eb5126ed-409d-4b18-89e4-43449943c616-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:35:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Acquiring lock "cinder-quobyte-eb5126ed-409d-4b18-89e4-43449943c616" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:35:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Lock "cinder-quobyte-eb5126ed-409d-4b18-89e4-43449943c616" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:35:16 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e15540f-e9d6-4ea0-a32a-d2803a331991]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:35:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-eb5126ed-409d-4b18-89e4-43449943c616 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:16 devstack sudo[88092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-eb5126ed-409d-4b18-89e4-43449943c616
Sep 16 08:35:16 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:17 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-eb5126ed-409d-4b18-89e4-43449943c616" returned: 0 in 0.751s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-eb5126ed-409d-4b18-89e4-43449943c616 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:17 devstack sudo[88106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-eb5126ed-409d-4b18-89e4-43449943c616
Sep 16 08:35:17 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:17 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-eb5126ed-409d-4b18-89e4-43449943c616" returned: 0 in 0.572s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Lock "cinder-quobyte-eb5126ed-409d-4b18-89e4-43449943c616" released by "delete_volume" :: held 1.390s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:35:17 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Created reservations ['03674994-521e-4bf4-afe9-d5df576104ef', 'fdd65503-8a22-417d-ac9c-e97442844e22', '3f80bcad-120f-4e8a-b448-beb980debc25', '8dd05afb-ab45-4d7d-a16d-19fa06c9552e'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:35:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:35:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:35:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:17 devstack sudo[88123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:35:17 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:18 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.291s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:18 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:35:18 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Deleted volume successfully.
Sep 16 08:35:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1a4a047-f96b-413c-8ac4-8ce5578332ef tempest-DeleteServersTestJSON-48758695 None] Lock "cinder-eb5126ed-409d-4b18-89e4-43449943c616-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Flow 'volume_create_manager' (276102fc-1282-4cd9-ba7c-ae6ccfe611a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28eef4b2-7932-4cd2-9b39-6fd074d0d4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28eef4b2-7932-4cd2-9b39-6fd074d0d4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1395603138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f504df9a-20f2-4812-8c21-801a8e312fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d134bdeea5484893b2035dee430540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:35:21Z,use_quota=True,user_id='9a8c2f728b3d454ba177d14f86a4a74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaeb49e-c1c2-4f19-bfe7-6d01023fe360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaeb49e-c1c2-4f19-bfe7-6d01023fe360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831916bd-7784-43e1-bbe1-26b85d24793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831916bd-7784-43e1-bbe1-26b85d24793a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f504df9a-20f2-4812-8c21-801a8e312fca', 'volume_name': 'volume-f504df9a-20f2-4812-8c21-801a8e312fca', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69715012-c8d6-4c8a-8c2b-60b10e3b4f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69715012-c8d6-4c8a-8c2b-60b10e3b4f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0455b1a-3ce8-4af2-b5e8-b070f8bb2546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:21 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Volume f504df9a-20f2-4812-8c21-801a8e312fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f504df9a-20f2-4812-8c21-801a8e312fca', 'volume_size': 1}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1395603138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f504df9a-20f2-4812-8c21-801a8e312fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d134bdeea5484893b2035dee430540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:35:21Z,use_quota=True,user_id='9a8c2f728b3d454ba177d14f86a4a74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Creating volume f504df9a-20f2-4812-8c21-801a8e312fca {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:35:21 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f504df9a-20f2-4812-8c21-801a8e312fca 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:21 devstack sudo[88135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f504df9a-20f2-4812-8c21-801a8e312fca 1073741824
Sep 16 08:35:21 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:21 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f504df9a-20f2-4812-8c21-801a8e312fca 1073741824" returned: 0 in 0.574s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f504df9a-20f2-4812-8c21-801a8e312fca {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:22 devstack sudo[88142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f504df9a-20f2-4812-8c21-801a8e312fca
Sep 16 08:35:22 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:22 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f504df9a-20f2-4812-8c21-801a8e312fca" returned: 0 in 0.360s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:35:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0455b1a-3ce8-4af2-b5e8-b070f8bb2546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f504df9a-20f2-4812-8c21-801a8e312fca', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d03cb22-d482-45df-8ec3-0296d7274473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:22 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Volume volume-f504df9a-20f2-4812-8c21-801a8e312fca (f504df9a-20f2-4812-8c21-801a8e312fca): created successfully
Sep 16 08:35:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d03cb22-d482-45df-8ec3-0296d7274473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Flow 'volume_create_manager' (276102fc-1282-4cd9-ba7c-ae6ccfe611a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:35:22 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c4396f00-dc0c-441b-bbad-8785137aa429 tempest-ServersNegativeTestJSON-1759141687 None] Created volume successfully.
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Flow 'volume_create_manager' (de2f20a4-1a8d-4349-b8db-d1ee5f9a07c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55820d8f-c340-4f33-9c41-3858e7a52269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55820d8f-c340-4f33-9c41-3858e7a52269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-414094856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506a2376-daba-4ca1-8578-7c58e8bfa59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d134bdeea5484893b2035dee430540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:35:26Z,use_quota=True,user_id='9a8c2f728b3d454ba177d14f86a4a74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49792c2-7c14-4d85-bb2a-04bd13ae9670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49792c2-7c14-4d85-bb2a-04bd13ae9670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bdfe5c-63eb-42c9-bfc5-2d0a9771cb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bdfe5c-63eb-42c9-bfc5-2d0a9771cb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '506a2376-daba-4ca1-8578-7c58e8bfa59b', 'volume_name': 'volume-506a2376-daba-4ca1-8578-7c58e8bfa59b', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7888d9-c8d6-48c7-b861-4c6d0ef9b8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7888d9-c8d6-48c7-b861-4c6d0ef9b8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f40144e-11d6-4cd0-83bb-175fb53dde10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:26 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Volume 506a2376-daba-4ca1-8578-7c58e8bfa59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-506a2376-daba-4ca1-8578-7c58e8bfa59b', 'volume_size': 1}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-414094856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506a2376-daba-4ca1-8578-7c58e8bfa59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d134bdeea5484893b2035dee430540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:35:26Z,use_quota=True,user_id='9a8c2f728b3d454ba177d14f86a4a74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Creating volume 506a2376-daba-4ca1-8578-7c58e8bfa59b {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:35:26 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:35:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-506a2376-daba-4ca1-8578-7c58e8bfa59b 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:26 devstack sudo[88148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-506a2376-daba-4ca1-8578-7c58e8bfa59b 1073741824
Sep 16 08:35:26 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:27 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-506a2376-daba-4ca1-8578-7c58e8bfa59b 1073741824" returned: 0 in 0.672s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-506a2376-daba-4ca1-8578-7c58e8bfa59b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:27 devstack sudo[88154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-506a2376-daba-4ca1-8578-7c58e8bfa59b
Sep 16 08:35:27 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:27 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-506a2376-daba-4ca1-8578-7c58e8bfa59b" returned: 0 in 0.328s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:35:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f40144e-11d6-4cd0-83bb-175fb53dde10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-506a2376-daba-4ca1-8578-7c58e8bfa59b', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07feeda6-4817-41ed-8193-25ad659145fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:27 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Volume volume-506a2376-daba-4ca1-8578-7c58e8bfa59b (506a2376-daba-4ca1-8578-7c58e8bfa59b): created successfully
Sep 16 08:35:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07feeda6-4817-41ed-8193-25ad659145fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Flow 'volume_create_manager' (de2f20a4-1a8d-4349-b8db-d1ee5f9a07c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:35:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-142a3e02-a72d-4cce-bbe3-b13c54236c26 tempest-ServersNegativeTestJSON-1759141687 None] Created volume successfully.
Sep 16 08:35:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Acquiring lock "cinder-506a2376-daba-4ca1-8578-7c58e8bfa59b-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:35:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Lock "cinder-506a2376-daba-4ca1-8578-7c58e8bfa59b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:35:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Acquiring lock "cinder-quobyte-506a2376-daba-4ca1-8578-7c58e8bfa59b" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:35:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Lock "cinder-quobyte-506a2376-daba-4ca1-8578-7c58e8bfa59b" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:35:31 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d77fee-fb70-4ddb-a1f7-f8285124905b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:35:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-506a2376-daba-4ca1-8578-7c58e8bfa59b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:31 devstack sudo[88196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-506a2376-daba-4ca1-8578-7c58e8bfa59b
Sep 16 08:35:31 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:31 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-506a2376-daba-4ca1-8578-7c58e8bfa59b" returned: 0 in 0.386s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-506a2376-daba-4ca1-8578-7c58e8bfa59b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:31 devstack sudo[88201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-506a2376-daba-4ca1-8578-7c58e8bfa59b
Sep 16 08:35:31 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:32 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-506a2376-daba-4ca1-8578-7c58e8bfa59b" returned: 0 in 0.278s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Lock "cinder-quobyte-506a2376-daba-4ca1-8578-7c58e8bfa59b" released by "delete_volume" :: held 0.725s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Created reservations ['0b6c7819-25f3-4784-9c9e-271fdbbe5a90', 'eec93827-9d3f-48a3-ae3a-778030d21af0', '384b162c-b512-4852-af73-89864319346b', '41afd803-dbea-464d-9a7e-83605d221802'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:32 devstack sudo[88205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:35:32 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:32 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.288s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Acquiring lock "cinder-f504df9a-20f2-4812-8c21-801a8e312fca-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:35:32 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Deleted volume successfully.
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fd59ebba-4d77-4cb4-92b4-4bb74a2fe673 tempest-ServersNegativeTestJSON-1759141687 None] Lock "cinder-506a2376-daba-4ca1-8578-7c58e8bfa59b-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Lock "cinder-f504df9a-20f2-4812-8c21-801a8e312fca-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Acquiring lock "cinder-quobyte-f504df9a-20f2-4812-8c21-801a8e312fca" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Lock "cinder-quobyte-f504df9a-20f2-4812-8c21-801a8e312fca" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f719238-afcb-4093-9fb1-9ffc1a04567c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:35:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f504df9a-20f2-4812-8c21-801a8e312fca {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:32 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f504df9a-20f2-4812-8c21-801a8e312fca
Sep 16 08:35:32 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:33 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f504df9a-20f2-4812-8c21-801a8e312fca" returned: 0 in 0.427s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f504df9a-20f2-4812-8c21-801a8e312fca {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:33 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f504df9a-20f2-4812-8c21-801a8e312fca
Sep 16 08:35:33 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:33 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f504df9a-20f2-4812-8c21-801a8e312fca" returned: 0 in 0.351s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Lock "cinder-quobyte-f504df9a-20f2-4812-8c21-801a8e312fca" released by "delete_volume" :: held 0.832s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Created reservations ['62b8bd12-4cb8-4e0b-b66d-3b720fbbf5ad', 'db51fa61-7eae-47b7-8bf5-54655fcaf57a', 'e6e359af-e15c-49be-8c29-b485811475f6', '31fe01b9-113e-4aa4-b4f3-0c3bfe1e30fe'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:33 devstack sudo[88216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:35:33 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:33 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.342s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:35:33 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Deleted volume successfully.
Sep 16 08:35:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bc94f515-eb0b-458f-9a24-469096e0cdca tempest-ServersNegativeTestJSON-1759141687 None] Lock "cinder-f504df9a-20f2-4812-8c21-801a8e312fca-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:35:41 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=33,cinder:UPDATE=49,cinder:INSERT=13,cinder:DELETE=5 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:35:41 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=39,cinder:UPDATE=43,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Flow 'volume_create_manager' (364aa24d-b2c4-4bc5-8aed-2a302ecad614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f75179-872b-4f1a-baa4-698f9aa27cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f75179-872b-4f1a-baa4-698f9aa27cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-983982780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8032045-2937-4dd1-a87a-38e187d0a0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f6573aac32442699ca19d87974458d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:35:59Z,use_quota=True,user_id='ba513c9ec89044b3b6c9da9596c2ec11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3903e7b6-a50d-4b1a-ac8a-c5a1279cae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3903e7b6-a50d-4b1a-ac8a-c5a1279cae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f361c6-26d3-46ea-85d5-a864c7226c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f361c6-26d3-46ea-85d5-a864c7226c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8032045-2937-4dd1-a87a-38e187d0a0a1', 'volume_name': 'volume-f8032045-2937-4dd1-a87a-38e187d0a0a1', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f39410-d4a2-4b73-b550-b9a26c761a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f39410-d4a2-4b73-b550-b9a26c761a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3adb8c3-70cb-4b06-92a9-df822378e68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:59 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Volume f8032045-2937-4dd1-a87a-38e187d0a0a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8032045-2937-4dd1-a87a-38e187d0a0a1', 'volume_size': 1}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-983982780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8032045-2937-4dd1-a87a-38e187d0a0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f6573aac32442699ca19d87974458d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:35:59Z,use_quota=True,user_id='ba513c9ec89044b3b6c9da9596c2ec11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Creating volume f8032045-2937-4dd1-a87a-38e187d0a0a1 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:35:59 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f8032045-2937-4dd1-a87a-38e187d0a0a1 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:35:59 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f8032045-2937-4dd1-a87a-38e187d0a0a1 1073741824
Sep 16 08:35:59 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Flow 'volume_create_manager' (bd9f2766-997c-4576-b2f9-efd51bdcceb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942a3c08-bbf1-4b7d-bf3b-b9d413472501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942a3c08-bbf1-4b7d-bf3b-b9d413472501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1340168840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7da648-c28c-4936-a9a1-ae1e413f1f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49962e285db47879d4a8efa8ce74850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:36:00Z,use_quota=True,user_id='ccdadf8e1883464fb72e5826253ae732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef9364a-a9af-4667-bc40-c510fbe38ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef9364a-a9af-4667-bc40-c510fbe38ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:35:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08897b5-f731-4d09-aa8a-4013c3b3ddbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08897b5-f731-4d09-aa8a-4013c3b3ddbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7da648-c28c-4936-a9a1-ae1e413f1f5e', 'volume_name': 'volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a07775a-a9b5-471f-87bc-052a49dfbec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a07775a-a9b5-471f-87bc-052a49dfbec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1338c5-596e-4874-9923-62663a403b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:00 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Volume 7a7da648-c28c-4936-a9a1-ae1e413f1f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e', 'volume_size': 1}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:00 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f8032045-2937-4dd1-a87a-38e187d0a0a1 1073741824" returned: 0 in 0.782s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f8032045-2937-4dd1-a87a-38e187d0a0a1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:00 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f8032045-2937-4dd1-a87a-38e187d0a0a1
Sep 16 08:36:00 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:00 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f8032045-2937-4dd1-a87a-38e187d0a0a1" returned: 0 in 0.263s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.341s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1340168840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7da648-c28c-4936-a9a1-ae1e413f1f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49962e285db47879d4a8efa8ce74850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:36:00Z,use_quota=True,user_id='ccdadf8e1883464fb72e5826253ae732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Creating volume 7a7da648-c28c-4936-a9a1-ae1e413f1f5e {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:36:00 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3adb8c3-70cb-4b06-92a9-df822378e68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8032045-2937-4dd1-a87a-38e187d0a0a1', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc37e1e3-c66f-4282-bb5f-ab9a3e3a6447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:00 devstack sudo[88300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e 1073741824
Sep 16 08:36:00 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:00 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Volume volume-f8032045-2937-4dd1-a87a-38e187d0a0a1 (f8032045-2937-4dd1-a87a-38e187d0a0a1): created successfully
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc37e1e3-c66f-4282-bb5f-ab9a3e3a6447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Flow 'volume_create_manager' (364aa24d-b2c4-4bc5-8aed-2a302ecad614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:36:00 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-244913d1-f434-4cb8-977f-20486e766b57 tempest-TaggedAttachmentsTest-911393166 None] Created volume successfully.
Sep 16 08:36:00 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e 1073741824" returned: 0 in 0.507s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:00 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e
Sep 16 08:36:00 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:01 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e" returned: 0 in 0.338s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:36:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1338c5-596e-4874-9923-62663a403b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc708006-7411-400d-8aba-390703aac6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:01 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Volume volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e (7a7da648-c28c-4936-a9a1-ae1e413f1f5e): created successfully
Sep 16 08:36:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc708006-7411-400d-8aba-390703aac6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Flow 'volume_create_manager' (bd9f2766-997c-4576-b2f9-efd51bdcceb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:36:01 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-baaa5a1e-df91-4782-a55a-fa697d29615e req-d21facdb-95ff-4dff-b5ef-ca9cbe7d49f7 tempest-VolumesSnapshotsTestJSON-2132835237 None] Created volume successfully.
Sep 16 08:36:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] Creating offline snapshot 6a15276c-6593-40e8-ae39-f383ec9da01f of volume 7a7da648-c28c-4936-a9a1-ae1e413f1f5e {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:36:02 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[214d9bd5-27e3-4e07-ae31-8f4eff011e8f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:36:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:02 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e
Sep 16 08:36:02 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:02 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e" returned: 0 in 0.550s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:02 devstack sudo[88317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f 1G
Sep 16 08:36:02 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:03 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f 1G" returned: 0 in 0.556s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:03 devstack sudo[88322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f
Sep 16 08:36:03 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:03 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f" returned: 0 in 0.535s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:04 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f is being set with open permissions: ugo+rw
Sep 16 08:36:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:04 devstack sudo[88365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f
Sep 16 08:36:04 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:04 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f" returned: 0 in 0.559s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:04 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.info
Sep 16 08:36:04 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:05 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.info" returned: 0 in 0.419s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:05 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.info is being set with open permissions: ugo+rw
Sep 16 08:36:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:05 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.info
Sep 16 08:36:05 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:05 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.info" returned: 0 in 0.326s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.125s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:05 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-d285fb58-7b27-4088-8ac5-ba1cdfd5d994 req-29e9574b-1b33-42aa-9ae4-0c5e24a311e8 tempest-VolumesSnapshotsTestJSON-2132835237 None] Create snapshot completed successfully
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Acquiring lock "cinder-6a15276c-6593-40e8-ae39-f383ec9da01f-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "cinder-6a15276c-6593-40e8-ae39-f383ec9da01f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Acquiring lock "cinder-quobyte-7a7da648-c28c-4936-a9a1-ae1e413f1f5e" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "cinder-quobyte-7a7da648-c28c-4936-a9a1-ae1e413f1f5e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Acquiring lock "cinder-quobyte-6a15276c-6593-40e8-ae39-f383ec9da01f" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "cinder-quobyte-6a15276c-6593-40e8-ae39-f383ec9da01f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Deleting offline snapshot 6a15276c-6593-40e8-ae39-f383ec9da01f of volume 7a7da648-c28c-4936-a9a1-ae1e413f1f5e {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] snapshot_file for this snap is: volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2084931f-cb72-4e13-a32f-53cb33a75d55]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:06 devstack sudo[88403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f
Sep 16 08:36:06 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:06 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f" returned: 0 in 0.575s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[59949e57-4659-428b-9a57-b03d284a27cb]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:36:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:07 devstack sudo[88414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e
Sep 16 08:36:07 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:07 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e" returned: 0 in 0.698s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:07 devstack sudo[88422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f
Sep 16 08:36:07 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:08 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f" returned: 0 in 0.656s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:08 devstack sudo[88427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f
Sep 16 08:36:08 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:08 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e.6a15276c-6593-40e8-ae39-f383ec9da01f" returned: 0 in 0.409s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:08 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "cinder-quobyte-6a15276c-6593-40e8-ae39-f383ec9da01f" released by "_delete_snapshot" :: held 2.656s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:36:08 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "cinder-quobyte-7a7da648-c28c-4936-a9a1-ae1e413f1f5e" released by "delete_snapshot" :: held 2.695s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:36:08 devstack cinder-volume[86261]: WARNING cinder.quota [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:36:09 devstack cinder-volume[86261]: DEBUG cinder.quota [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Created reservations ['3ca0cf87-cd01-4118-bda1-6cdc3f1b90a3', 'ac9c5c8e-9925-4b8a-9a89-1d94fea14417', 'd23815e0-615a-462c-9778-591ae1e3b84c', '5461bce5-98f5-4e23-8445-4d282905377a'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:36:09 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Delete snapshot completed successfully.
Sep 16 08:36:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-daad76c4-1496-41b3-9c31-4f24a421c880 req-733985dd-0191-44fd-992a-fe0a8dc4cd12 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "cinder-6a15276c-6593-40e8-ae39-f383ec9da01f-delete_snapshot" released by "delete_snapshot" :: held 2.988s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:36:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Acquiring lock "cinder-7a7da648-c28c-4936-a9a1-ae1e413f1f5e-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:36:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "cinder-7a7da648-c28c-4936-a9a1-ae1e413f1f5e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:36:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Acquiring lock "cinder-quobyte-7a7da648-c28c-4936-a9a1-ae1e413f1f5e" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:36:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "cinder-quobyte-7a7da648-c28c-4936-a9a1-ae1e413f1f5e" acquired by "delete_volume" :: waited 0.031s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:36:11 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e691b8-cfc9-4b45-81ce-a6b95204a70b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:36:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:11 devstack sudo[88448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e
Sep 16 08:36:11 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:12 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e" returned: 0 in 0.714s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:12 devstack sudo[88453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e
Sep 16 08:36:12 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:12 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7a7da648-c28c-4936-a9a1-ae1e413f1f5e" returned: 0 in 0.305s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "cinder-quobyte-7a7da648-c28c-4936-a9a1-ae1e413f1f5e" released by "delete_volume" :: held 1.129s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG cinder.quota [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Created reservations ['b864cd63-75ac-46cc-9b67-26b3a96ea389', '40a0f4ad-5466-42ba-a38c-83f490149614', 'c9528f4a-6ded-4031-b5d4-ff0e5fc93281', 'ab9aafbf-14ed-4c8a-be17-81723b1d47fd'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:12 devstack sudo[88456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:36:12 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:12 devstack sudo[88458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:36:12 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:12 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:12 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.296s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:12 devstack cinder-volume[86261]: DEBUG cinder.manager [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:36:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.425s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:36:13 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Deleted volume successfully.
Sep 16 08:36:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-f71ec12e-1efa-4738-92ed-09a9c5bac7cb req-7131d25f-f01a-4424-a994-e7f831ebb9d5 tempest-VolumesSnapshotsTestJSON-2132835237 None] Lock "cinder-7a7da648-c28c-4936-a9a1-ae1e413f1f5e-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Flow 'volume_create_manager' (2b115c2a-cf1c-4e96-b810-8560a735b98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893b000a-7eeb-4b2a-bd58-5b94c6d46ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893b000a-7eeb-4b2a-bd58-5b94c6d46ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1312855616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e271d597-e571-42a9-8cad-820d541edd05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='86f5bb58b9604a78b4a753cb7926a1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:36:21Z,use_quota=True,user_id='db1462ade61240a1b7258507d14d79e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41762a01-4fe2-4f72-bb88-f6309a773e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41762a01-4fe2-4f72-bb88-f6309a773e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68424eda-c055-41fa-9794-01a761b036a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68424eda-c055-41fa-9794-01a761b036a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e271d597-e571-42a9-8cad-820d541edd05', 'volume_name': 'volume-e271d597-e571-42a9-8cad-820d541edd05', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ee9dd7-d0b2-49b5-b2b0-50a391d672fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ee9dd7-d0b2-49b5-b2b0-50a391d672fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a55d69-66b2-4d4f-8574-091ed9189875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:20 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Volume e271d597-e571-42a9-8cad-820d541edd05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e271d597-e571-42a9-8cad-820d541edd05', 'volume_size': 1}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1312855616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e271d597-e571-42a9-8cad-820d541edd05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='86f5bb58b9604a78b4a753cb7926a1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:36:21Z,use_quota=True,user_id='db1462ade61240a1b7258507d14d79e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Creating volume e271d597-e571-42a9-8cad-820d541edd05 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:36:20 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:36:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e271d597-e571-42a9-8cad-820d541edd05 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:21 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e271d597-e571-42a9-8cad-820d541edd05 1073741824
Sep 16 08:36:21 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:21 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e271d597-e571-42a9-8cad-820d541edd05 1073741824" returned: 0 in 0.801s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e271d597-e571-42a9-8cad-820d541edd05 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:21 devstack sudo[88580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e271d597-e571-42a9-8cad-820d541edd05
Sep 16 08:36:21 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:22 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e271d597-e571-42a9-8cad-820d541edd05" returned: 0 in 0.534s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:36:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a55d69-66b2-4d4f-8574-091ed9189875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e271d597-e571-42a9-8cad-820d541edd05', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c4adfb-d7c2-4394-a87b-d1b56c436569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:22 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Volume volume-e271d597-e571-42a9-8cad-820d541edd05 (e271d597-e571-42a9-8cad-820d541edd05): created successfully
Sep 16 08:36:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c4adfb-d7c2-4394-a87b-d1b56c436569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Flow 'volume_create_manager' (2b115c2a-cf1c-4e96-b810-8560a735b98b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:36:22 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-3f08cf36-3c88-42fe-9a4b-bf5b56b693cd req-8ad64aa7-55d9-41b0-8ef3-aa1ee2269944 tempest-VolumesGetTestJSON-824542172 None] Created volume successfully.
Sep 16 08:36:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Acquiring lock "cinder-e271d597-e571-42a9-8cad-820d541edd05-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:36:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Lock "cinder-e271d597-e571-42a9-8cad-820d541edd05-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:36:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Acquiring lock "cinder-quobyte-e271d597-e571-42a9-8cad-820d541edd05" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:36:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Lock "cinder-quobyte-e271d597-e571-42a9-8cad-820d541edd05" acquired by "delete_volume" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:36:23 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4f8c33-6fb2-4fc1-851f-7b97720cf7b9]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:36:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e271d597-e571-42a9-8cad-820d541edd05 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:23 devstack sudo[88589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e271d597-e571-42a9-8cad-820d541edd05
Sep 16 08:36:23 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:24 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e271d597-e571-42a9-8cad-820d541edd05" returned: 0 in 0.491s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e271d597-e571-42a9-8cad-820d541edd05 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:24 devstack sudo[88596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e271d597-e571-42a9-8cad-820d541edd05
Sep 16 08:36:24 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:24 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e271d597-e571-42a9-8cad-820d541edd05" returned: 0 in 0.316s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Lock "cinder-quobyte-e271d597-e571-42a9-8cad-820d541edd05" released by "delete_volume" :: held 0.979s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:36:24 devstack cinder-volume[86261]: DEBUG cinder.quota [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Created reservations ['0074e8e6-2053-4c47-a2c6-7619124c899f', '74384cd7-47cd-4275-a039-44c51a4a78ea', '3eebd387-9d64-4fb7-bfa5-ff743a5e5a14', '997d601d-cd8d-4a6b-a392-85ac2bc58bfd'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:36:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:36:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:36:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:24 devstack sudo[88613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:36:24 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:25 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.547s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:25 devstack cinder-volume[86261]: DEBUG cinder.manager [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:36:25 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Deleted volume successfully.
Sep 16 08:36:25 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-559e5797-b91e-466a-88cf-8899e04687c3 req-104d8ea3-ec51-4898-9177-f69425f405fa tempest-VolumesGetTestJSON-824542172 None] Lock "cinder-e271d597-e571-42a9-8cad-820d541edd05-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:36:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6b822e8d-0759-43b4-85f3-645ded652b36 tempest-BackendsCapabilitiesAdminTestsJSON-1460232100 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.93851852417, 'free_capacity_gb': 1775.93851852417, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86261) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 16 08:36:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-61dbabba-6405-4f66-94ee-da53c99e8a30 tempest-BackendsCapabilitiesAdminTestsJSON-1460232100 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.93851852417, 'free_capacity_gb': 1775.93851852417, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86261) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Flow 'volume_create_manager' (76f7b711-519a-4af2-8b5d-a364ee7ee2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8614eef-1a6a-4fb0-a6fd-66ff9b43043c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8614eef-1a6a-4fb0-a6fd-66ff9b43043c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-694004360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64b76de-02d9-4121-91f5-eb14ed6cb8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ded7620f37d44028d74b470d57baa4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:36:34Z,use_quota=True,user_id='34a28340f13148b781ebba95dabd62bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a22679-b0e9-4f70-ba0a-41562401f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a22679-b0e9-4f70-ba0a-41562401f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b50521d-341c-4190-a377-b496b7581dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b50521d-341c-4190-a377-b496b7581dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c64b76de-02d9-4121-91f5-eb14ed6cb8cc', 'volume_name': 'volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8beb7cf1-cf04-4d0e-97ea-fdef47977417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8beb7cf1-cf04-4d0e-97ea-fdef47977417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222adef9-859e-4f6c-b2ac-7aac5b475d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:34 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Volume c64b76de-02d9-4121-91f5-eb14ed6cb8cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc', 'volume_size': 1}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-694004360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64b76de-02d9-4121-91f5-eb14ed6cb8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ded7620f37d44028d74b470d57baa4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:36:34Z,use_quota=True,user_id='34a28340f13148b781ebba95dabd62bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Creating volume c64b76de-02d9-4121-91f5-eb14ed6cb8cc {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:36:34 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:36:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:34 devstack sudo[88754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc 1073741824
Sep 16 08:36:34 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:35 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc 1073741824" returned: 0 in 0.500s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:35 devstack sudo[88760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc
Sep 16 08:36:35 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:35 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc" returned: 0 in 0.289s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:36:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222adef9-859e-4f6c-b2ac-7aac5b475d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31964989-86e6-431e-a28e-808dbddf7817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:35 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Volume volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc (c64b76de-02d9-4121-91f5-eb14ed6cb8cc): created successfully
Sep 16 08:36:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31964989-86e6-431e-a28e-808dbddf7817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Flow 'volume_create_manager' (76f7b711-519a-4af2-8b5d-a364ee7ee2d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:36:35 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-6f2d36b4-9698-45e2-a0ed-272c9e14ce64 tempest-AttachVolumeTestJSON-1675038212 None] Created volume successfully.
Sep 16 08:36:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-6820df33-dcb6-42b6-8235-d06f8309bf94 req-e2c19f8f-1ded-41f7-9db1-086b4d7fa9ac tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-6820df33-dcb6-42b6-8235-d06f8309bf94 req-e2c19f8f-1ded-41f7-9db1-086b4d7fa9ac tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-6820df33-dcb6-42b6-8235-d06f8309bf94 req-e2c19f8f-1ded-41f7-9db1-086b4d7fa9ac tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-6820df33-dcb6-42b6-8235-d06f8309bf94 req-e2c19f8f-1ded-41f7-9db1-086b4d7fa9ac tempest-AttachVolumeTestJSON-1675038212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '914bb618-42a6-4eee-a143-317472aee689', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:36:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-6820df33-dcb6-42b6-8235-d06f8309bf94 req-e2c19f8f-1ded-41f7-9db1-086b4d7fa9ac tempest-AttachVolumeTestJSON-1675038212 None] attachment_update completed successfully.
Sep 16 08:36:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-19b68550-b39d-4d23-88ea-38a7429f224e tempest-GroupSnapshotsV319Test-1206142329 None] Group tempest-GroupSnapshotsV319Test-Group-369148082: creating
Sep 16 08:36:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-19b68550-b39d-4d23-88ea-38a7429f224e tempest-GroupSnapshotsV319Test-1206142329 None] Group tempest-GroupSnapshotsV319Test-Group-369148082: created successfully
Sep 16 08:36:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-19b68550-b39d-4d23-88ea-38a7429f224e tempest-GroupSnapshotsV319Test-1206142329 None] Create group completed successfully.
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Flow 'volume_create_manager' (c4981fd1-79fa-4ec1-9a8c-f97a837b0333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bcac47f-d1e2-4212-8dd0-66f92f091c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bcac47f-d1e2-4212-8dd0-66f92f091c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-469929770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b8115626-f836-4907-9fc2-f8d8f7bac904,host='devstack@QuobyteHD#QuobyteHD',id=a1f14f34-d792-4036-97db-e9e8736c5d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2987de9a554e1a971bed35e2308ae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:36:40Z,use_quota=True,user_id='14978d41bd344dc59d110b4dd31909ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d87ead02-e3bc-408b-b239-fc0dff6a9944),volume_type_id=d87ead02-e3bc-408b-b239-fc0dff6a9944)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3fb316-c353-4872-b668-01eb900f131e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3fb316-c353-4872-b668-01eb900f131e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c4b003-bfae-4460-a933-afbd81ad22c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c4b003-bfae-4460-a933-afbd81ad22c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f14f34-d792-4036-97db-e9e8736c5d16', 'volume_name': 'volume-a1f14f34-d792-4036-97db-e9e8736c5d16', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cd296b-456e-40c1-989c-e2728c695e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cd296b-456e-40c1-989c-e2728c695e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b42b810-35fa-4da6-b1b6-cdee6ce146dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:40 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Volume a1f14f34-d792-4036-97db-e9e8736c5d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f14f34-d792-4036-97db-e9e8736c5d16', 'volume_size': 1}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b8115626-f836-4907-9fc2-f8d8f7bac904,created_at=2026-09-16T06:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-469929770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b8115626-f836-4907-9fc2-f8d8f7bac904,host='devstack@QuobyteHD#QuobyteHD',id=a1f14f34-d792-4036-97db-e9e8736c5d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2987de9a554e1a971bed35e2308ae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:36:40Z,use_quota=True,user_id='14978d41bd344dc59d110b4dd31909ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d87ead02-e3bc-408b-b239-fc0dff6a9944),volume_type_id=d87ead02-e3bc-408b-b239-fc0dff6a9944)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Creating volume a1f14f34-d792-4036-97db-e9e8736c5d16 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:36:40 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:40 devstack sudo[89218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16 1073741824
Sep 16 08:36:40 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:40 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16 1073741824" returned: 0 in 0.429s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:41 devstack sudo[89224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16
Sep 16 08:36:41 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:41 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16" returned: 0 in 0.273s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:36:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b42b810-35fa-4da6-b1b6-cdee6ce146dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f14f34-d792-4036-97db-e9e8736c5d16', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba26be0b-7564-46c6-8be2-2d55a9904d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:41 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Volume volume-a1f14f34-d792-4036-97db-e9e8736c5d16 (a1f14f34-d792-4036-97db-e9e8736c5d16): created successfully
Sep 16 08:36:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba26be0b-7564-46c6-8be2-2d55a9904d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Flow 'volume_create_manager' (c4981fd1-79fa-4ec1-9a8c-f97a837b0333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:36:41 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-16461a37-9054-4949-9731-5d931a77957b tempest-GroupSnapshotsV319Test-1206142329 None] Created volume successfully.
Sep 16 08:36:42 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] GroupSnapshot 97c0b058-2933-4424-8c2a-5adaeb4d10cf: creating.
Sep 16 08:36:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] Group snapshot 97c0b058-2933-4424-8c2a-5adaeb4d10cf: creating. {{(pid=86261) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 16 08:36:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:42 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] Creating offline snapshot b97f29f0-7b9c-49a4-9a95-83dfb358874f of volume a1f14f34-d792-4036-97db-e9e8736c5d16 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:36:42 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e16b24d-b2bd-4fd1-83c0-cae73fc3371a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:36:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:42 devstack sudo[89228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16
Sep 16 08:36:42 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:42 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16" returned: 0 in 0.712s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:43 devstack sudo[89305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f 1G
Sep 16 08:36:43 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:43 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f 1G" returned: 0 in 0.806s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1f14f34-d792-4036-97db-e9e8736c5d16 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:43 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1f14f34-d792-4036-97db-e9e8736c5d16 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f
Sep 16 08:36:43 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:44 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1f14f34-d792-4036-97db-e9e8736c5d16 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f" returned: 0 in 0.334s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:44 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:36:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:44 devstack sudo[89426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f
Sep 16 08:36:44 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:44 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f" returned: 0 in 0.451s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:44 devstack sudo[89780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.info
Sep 16 08:36:44 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:45 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.info" returned: 0 in 0.400s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:45 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:36:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:45 devstack sudo[89803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.info
Sep 16 08:36:45 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:45 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.info" returned: 0 in 0.479s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.340s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:45 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-45d2e5d6-6972-4d48-8075-1650bda4f6b4 tempest-GroupSnapshotsV319Test-1206142329 None] group_snapshot 97c0b058-2933-4424-8c2a-5adaeb4d10cf: created successfully
Sep 16 08:36:47 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] group_snapshot 97c0b058-2933-4424-8c2a-5adaeb4d10cf: deleting
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] group_snapshot 97c0b058-2933-4424-8c2a-5adaeb4d10cf: deleting {{(pid=86261) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Acquiring lock "cinder-quobyte-a1f14f34-d792-4036-97db-e9e8736c5d16" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Lock "cinder-quobyte-a1f14f34-d792-4036-97db-e9e8736c5d16" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Acquiring lock "cinder-quobyte-b97f29f0-7b9c-49a4-9a95-83dfb358874f" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Lock "cinder-quobyte-b97f29f0-7b9c-49a4-9a95-83dfb358874f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Deleting offline snapshot b97f29f0-7b9c-49a4-9a95-83dfb358874f of volume a1f14f34-d792-4036-97db-e9e8736c5d16 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] snapshot_file for this snap is: volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd9df40-aa5f-4436-8782-68811ffd43a8]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:47 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f
Sep 16 08:36:47 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:47 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f" returned: 0 in 0.434s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1f14f34-d792-4036-97db-e9e8736c5d16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3197d7f0-384d-4f1e-b0e5-c608ec82a3fa]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:36:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:48 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16
Sep 16 08:36:48 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:48 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16" returned: 0 in 0.959s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:48 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f
Sep 16 08:36:48 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:49 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f" returned: 0 in 0.691s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:49 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f
Sep 16 08:36:49 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:49 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16.b97f29f0-7b9c-49a4-9a95-83dfb358874f" returned: 0 in 0.407s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Lock "cinder-quobyte-b97f29f0-7b9c-49a4-9a95-83dfb358874f" released by "_delete_snapshot" :: held 2.696s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:36:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Lock "cinder-quobyte-a1f14f34-d792-4036-97db-e9e8736c5d16" released by "delete_snapshot" :: held 2.729s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:36:50 devstack cinder-volume[86261]: WARNING cinder.quota [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-149448166 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-149448166, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:36:50 devstack cinder-volume[86261]: WARNING cinder.quota [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-149448166 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-149448166, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:36:50 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] Created reservations ['d3cad658-1fb6-476a-a064-cdd05825ed43', 'd530e661-265e-4861-bf5e-fde31707095e', 'd83e0ddc-b288-40ff-aeeb-5da0c1c4172a', '226d291d-e8b2-4cf7-b42d-292424107872'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:36:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0ad9d601-0e58-4f05-acc1-88be4136ad81 tempest-GroupSnapshotsV319Test-1206142329 None] group_snapshot 97c0b058-2933-4424-8c2a-5adaeb4d10cf: deleted successfully
Sep 16 08:36:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-1c3be4bb-4efb-4fef-a198-ab83f5c2ffde req-2ddf3163-853f-40b5-8cfb-fbe5b0e26b7b tempest-TaggedAttachmentsTest-911393166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-1c3be4bb-4efb-4fef-a198-ab83f5c2ffde req-2ddf3163-853f-40b5-8cfb-fbe5b0e26b7b tempest-TaggedAttachmentsTest-911393166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-1c3be4bb-4efb-4fef-a198-ab83f5c2ffde req-2ddf3163-853f-40b5-8cfb-fbe5b0e26b7b tempest-TaggedAttachmentsTest-911393166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-1c3be4bb-4efb-4fef-a198-ab83f5c2ffde req-2ddf3163-853f-40b5-8cfb-fbe5b0e26b7b tempest-TaggedAttachmentsTest-911393166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-f8032045-2937-4dd1-a87a-38e187d0a0a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba5252c1-14ad-4dab-a5d5-19bd3d067e51', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:36:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-1c3be4bb-4efb-4fef-a198-ab83f5c2ffde req-2ddf3163-853f-40b5-8cfb-fbe5b0e26b7b tempest-TaggedAttachmentsTest-911393166 None] attachment_update completed successfully.
Sep 16 08:36:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Acquiring lock "cinder-quobyte-a1f14f34-d792-4036-97db-e9e8736c5d16" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:36:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Lock "cinder-quobyte-a1f14f34-d792-4036-97db-e9e8736c5d16" acquired by "delete_volume" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:36:51 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a69dae4-61a6-4b0a-8d4c-42718190c983]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:36:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:51 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16
Sep 16 08:36:51 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:51 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16" returned: 0 in 0.506s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:51 devstack sudo[89908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16
Sep 16 08:36:51 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:51 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a1f14f34-d792-4036-97db-e9e8736c5d16" returned: 0 in 0.317s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Lock "cinder-quobyte-a1f14f34-d792-4036-97db-e9e8736c5d16" released by "delete_volume" :: held 0.894s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:36:51 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=56,cinder:UPDATE=53,cinder:INSERT=10,cinder:DELETE=7 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:36:51 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=59,cinder:UPDATE=49,cinder:INSERT=13,cinder:DELETE=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:36:52 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Created reservations ['5788c7b1-5c8a-4ad0-a63b-cb4db810e5ab'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:36:52 devstack cinder-volume[86261]: WARNING cinder.quota [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-149448166 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-149448166, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:36:52 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Created reservations ['e9fcacb9-aa7b-4525-ae21-c2fe5315c4e8', '4baed4c8-a92c-472a-91d8-7a91adbb0389', '062b4a36-d2cd-41c2-ab01-8a54614ba928', 'b4e6e993-a0e6-40f1-a0d5-14965dca31ba'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:36:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:36:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:36:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:52 devstack sudo[89915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:36:52 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:52 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.358s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:52 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:36:52 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bb18e609-6a07-4cdb-b778-f8d6fcc76f19 tempest-GroupSnapshotsV319Test-1206142329 None] Delete group completed successfully.
Sep 16 08:36:53 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-e436959f-7d53-46a1-9eaa-0f0bb5bc56e1 req-14d73004-e37d-4324-b29a-56f77aa2d7d5 tempest-TaggedAttachmentsTest-911393166 None] Terminate volume connection completed successfully.
Sep 16 08:36:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-e436959f-7d53-46a1-9eaa-0f0bb5bc56e1 req-14d73004-e37d-4324-b29a-56f77aa2d7d5 tempest-TaggedAttachmentsTest-911393166 None] Deleting attachment ba5252c1-14ad-4dab-a5d5-19bd3d067e51. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Flow 'volume_create_manager' (ac819d81-3b3f-4a87-9a6a-c108f4622e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a53d20a-109f-44ca-92fb-2a837c527540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a53d20a-109f-44ca-92fb-2a837c527540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1421148353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e70a0da-725d-47eb-9167-709d77b5982a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bccbcbf6137438b8f314a4126941f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:36:54Z,use_quota=True,user_id='ed93eb0531ca429388d479d192794cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778d2736-a996-4292-a097-e12fd75c7a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778d2736-a996-4292-a097-e12fd75c7a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484fdd4b-586a-416a-9f46-5f19a9e53709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484fdd4b-586a-416a-9f46-5f19a9e53709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e70a0da-725d-47eb-9167-709d77b5982a', 'volume_name': 'volume-1e70a0da-725d-47eb-9167-709d77b5982a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86204f9-e049-4a16-afe7-54d9e1fe5ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86204f9-e049-4a16-afe7-54d9e1fe5ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0ce666-eab0-4136-b54f-b6187cebd832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:54 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Volume 1e70a0da-725d-47eb-9167-709d77b5982a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e70a0da-725d-47eb-9167-709d77b5982a', 'volume_size': 1}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1421148353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e70a0da-725d-47eb-9167-709d77b5982a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bccbcbf6137438b8f314a4126941f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:36:54Z,use_quota=True,user_id='ed93eb0531ca429388d479d192794cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Creating volume 1e70a0da-725d-47eb-9167-709d77b5982a {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:36:54 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:36:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e70a0da-725d-47eb-9167-709d77b5982a 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:54 devstack sudo[89930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e70a0da-725d-47eb-9167-709d77b5982a 1073741824
Sep 16 08:36:54 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:55 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e70a0da-725d-47eb-9167-709d77b5982a 1073741824" returned: 0 in 0.945s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e70a0da-725d-47eb-9167-709d77b5982a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:36:55 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e70a0da-725d-47eb-9167-709d77b5982a
Sep 16 08:36:55 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:36:55 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Sep 16 08:36:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e70a0da-725d-47eb-9167-709d77b5982a" returned: 0 in 0.357s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:36:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:36:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:36:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0ce666-eab0-4136-b54f-b6187cebd832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e70a0da-725d-47eb-9167-709d77b5982a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe77233-f1c0-435e-8549-e98b7404c57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:36:55 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Volume volume-1e70a0da-725d-47eb-9167-709d77b5982a (1e70a0da-725d-47eb-9167-709d77b5982a): created successfully
Sep 16 08:36:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe77233-f1c0-435e-8549-e98b7404c57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:36:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Flow 'volume_create_manager' (ac819d81-3b3f-4a87-9a6a-c108f4622e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:36:55 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b5f00267-7a2b-4441-9d1e-571cbb15df2c tempest-AttachVolumeShelveTestJSON-647534628 None] Created volume successfully.
Sep 16 08:37:01 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9e6afaae-f966-4098-9802-b905150771bf tempest-GroupsV320Test-1370032544 None] Group tempest-GroupsV320Test-Group-1343045490: creating
Sep 16 08:37:01 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9e6afaae-f966-4098-9802-b905150771bf tempest-GroupsV320Test-1370032544 None] Group tempest-GroupsV320Test-Group-1343045490: created successfully
Sep 16 08:37:01 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9e6afaae-f966-4098-9802-b905150771bf tempest-GroupsV320Test-1370032544 None] Create group completed successfully.
Sep 16 08:37:02 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-46d8ac2a-d274-46a9-b1db-1b8b5e373cb7 tempest-GroupsV320Test-1370032544 None] Created reservations ['c2a9a688-e4f0-4dd2-8c84-7b6484af6241'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:37:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-46d8ac2a-d274-46a9-b1db-1b8b5e373cb7 tempest-GroupsV320Test-1370032544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:37:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-46d8ac2a-d274-46a9-b1db-1b8b5e373cb7 tempest-GroupsV320Test-1370032544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:37:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-46d8ac2a-d274-46a9-b1db-1b8b5e373cb7 tempest-GroupsV320Test-1370032544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:37:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-46d8ac2a-d274-46a9-b1db-1b8b5e373cb7 tempest-GroupsV320Test-1370032544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:37:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-46d8ac2a-d274-46a9-b1db-1b8b5e373cb7 tempest-GroupsV320Test-1370032544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:37:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-46d8ac2a-d274-46a9-b1db-1b8b5e373cb7 tempest-GroupsV320Test-1370032544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:02 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:37:02 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:03 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-46d8ac2a-d274-46a9-b1db-1b8b5e373cb7 tempest-GroupsV320Test-1370032544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.247s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:03 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-46d8ac2a-d274-46a9-b1db-1b8b5e373cb7 tempest-GroupsV320Test-1370032544 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:37:03 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-46d8ac2a-d274-46a9-b1db-1b8b5e373cb7 tempest-GroupsV320Test-1370032544 None] Delete group completed successfully.
Sep 16 08:37:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-cb6f1bc3-4a48-4862-939d-de7ef9e656d4 req-8eda489c-f8ff-4317-a550-970ba277b562 tempest-AttachVolumeShelveTestJSON-647534628 None] No connector for attachment 4d367363-5ee6-4b64-8376-40c4edd2c37a; skipping storage backend terminate_connection call. {{(pid=86261) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 16 08:37:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-cb6f1bc3-4a48-4862-939d-de7ef9e656d4 req-8eda489c-f8ff-4317-a550-970ba277b562 tempest-AttachVolumeShelveTestJSON-647534628 None] Deleting attachment 4d367363-5ee6-4b64-8376-40c4edd2c37a. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:37:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Acquiring lock "cinder-f8032045-2937-4dd1-a87a-38e187d0a0a1-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:37:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Lock "cinder-f8032045-2937-4dd1-a87a-38e187d0a0a1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:37:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Acquiring lock "cinder-quobyte-f8032045-2937-4dd1-a87a-38e187d0a0a1" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:37:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Lock "cinder-quobyte-f8032045-2937-4dd1-a87a-38e187d0a0a1" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:37:06 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1d2b1a-1b6f-4421-b949-d24bf2d5f864]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:37:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f8032045-2937-4dd1-a87a-38e187d0a0a1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:06 devstack sudo[90068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f8032045-2937-4dd1-a87a-38e187d0a0a1
Sep 16 08:37:06 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:07 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f8032045-2937-4dd1-a87a-38e187d0a0a1" returned: 0 in 0.623s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f8032045-2937-4dd1-a87a-38e187d0a0a1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:07 devstack sudo[90074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f8032045-2937-4dd1-a87a-38e187d0a0a1
Sep 16 08:37:07 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:07 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f8032045-2937-4dd1-a87a-38e187d0a0a1" returned: 0 in 0.327s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Lock "cinder-quobyte-f8032045-2937-4dd1-a87a-38e187d0a0a1" released by "delete_volume" :: held 1.012s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:37:07 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Created reservations ['2f5e5712-27bd-4b45-96a0-6b423d8dd4fa', 'ab003e20-2226-4baa-9bc1-efc68201db60', '0fc2ee0c-cb32-43dc-a865-9da037528c81', '98d9c645-0a77-47d3-bd55-e66a14b25650'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:37:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:37:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:37:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:37:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:37:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:37:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:07 devstack sudo[90077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:37:07 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:08 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.402s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:08 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:37:08 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Deleted volume successfully.
Sep 16 08:37:08 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18c9a114-2d88-40dc-829c-0d40aa1d5cae tempest-TaggedAttachmentsTest-911393166 None] Lock "cinder-f8032045-2937-4dd1-a87a-38e187d0a0a1-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:37:11 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-21f49706-4413-48cb-b9ff-aa1114a9e0d0 req-be8313a0-44b5-4fd4-95b3-532e0898acab tempest-AttachVolumeTestJSON-1675038212 None] Terminate volume connection completed successfully.
Sep 16 08:37:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-21f49706-4413-48cb-b9ff-aa1114a9e0d0 req-be8313a0-44b5-4fd4-95b3-532e0898acab tempest-AttachVolumeTestJSON-1675038212 None] Deleting attachment 914bb618-42a6-4eee-a143-317472aee689. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:37:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:37:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:37:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:37:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:37:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:37:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:37:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:12 devstack sudo[90094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:37:12 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:12 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.371s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:37:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:37:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 9 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:37:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:37:21 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=25,cinder:SELECT=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:37:21 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=21,cinder:INSERT=6,cinder:UPDATE=24 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Flow 'volume_create_manager' (8f1183a1-9a12-40d6-8114-fddf8623bd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40520607-e3b6-4af2-ade5-3114155b3213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40520607-e3b6-4af2-ade5-3114155b3213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2005769718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a146466c-a9c9-4445-904c-df09df60c837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bb1a5c47b749edb205c88506da92b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:37:33Z,use_quota=True,user_id='c073828f3f4f4cbbb0992537af1998c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e61051-fb36-4e22-be76-b06741cc6885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e61051-fb36-4e22-be76-b06741cc6885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173802c2-65b0-488b-9525-c1e95815cb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173802c2-65b0-488b-9525-c1e95815cb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a146466c-a9c9-4445-904c-df09df60c837', 'volume_name': 'volume-a146466c-a9c9-4445-904c-df09df60c837', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2515e1-40bd-4351-8ed8-1acdeec3a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2515e1-40bd-4351-8ed8-1acdeec3a05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4806cdca-2ff4-44f0-b0d0-3b4978422dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:37:33 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Volume a146466c-a9c9-4445-904c-df09df60c837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a146466c-a9c9-4445-904c-df09df60c837', 'volume_size': 1}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2005769718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a146466c-a9c9-4445-904c-df09df60c837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8bb1a5c47b749edb205c88506da92b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:37:33Z,use_quota=True,user_id='c073828f3f4f4cbbb0992537af1998c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Creating volume a146466c-a9c9-4445-904c-df09df60c837 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:37:33 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:37:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:33 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837 1073741824
Sep 16 08:37:33 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:34 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837 1073741824" returned: 0 in 0.691s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:34 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837
Sep 16 08:37:34 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:34 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837" returned: 0 in 0.269s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:37:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:37:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4806cdca-2ff4-44f0-b0d0-3b4978422dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a146466c-a9c9-4445-904c-df09df60c837', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:37:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64a13f8-51ef-466d-aa38-9870313d1921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:37:34 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Volume volume-a146466c-a9c9-4445-904c-df09df60c837 (a146466c-a9c9-4445-904c-df09df60c837): created successfully
Sep 16 08:37:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64a13f8-51ef-466d-aa38-9870313d1921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:37:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Flow 'volume_create_manager' (8f1183a1-9a12-40d6-8114-fddf8623bd72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:37:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3fb3e5bb-c36c-4292-9230-1511ddd13545 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Created volume successfully.
Sep 16 08:37:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:37:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:37:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Creating offline snapshot 4b4bb43c-20e1-4a26-a797-bb176b731c25 of volume a146466c-a9c9-4445-904c-df09df60c837 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:37:35 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3b91d7-1ddc-43fd-97e4-90bbf66ffa24]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:37:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:35 devstack sudo[90358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837
Sep 16 08:37:35 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:36 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837" returned: 0 in 0.406s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:36 devstack sudo[90363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25 1G
Sep 16 08:37:36 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:36 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25 1G" returned: 0 in 0.462s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a146466c-a9c9-4445-904c-df09df60c837 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:36 devstack sudo[90369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a146466c-a9c9-4445-904c-df09df60c837 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25
Sep 16 08:37:36 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:36 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a146466c-a9c9-4445-904c-df09df60c837 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25" returned: 0 in 0.361s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:37 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25 is being set with open permissions: ugo+rw
Sep 16 08:37:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:37 devstack sudo[90376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25
Sep 16 08:37:37 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:37 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25" returned: 0 in 0.295s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:37 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.info
Sep 16 08:37:37 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:37 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.info" returned: 0 in 0.287s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:37 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.info is being set with open permissions: ugo+rw
Sep 16 08:37:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:37 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.info
Sep 16 08:37:37 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:37 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.info" returned: 0 in 0.275s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.204s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:37:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1fd3108b-ed19-498f-b630-3d077eae5aad tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Create snapshot completed successfully
Sep 16 08:37:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Acquiring lock "cinder-4b4bb43c-20e1-4a26-a797-bb176b731c25-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:37:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "cinder-4b4bb43c-20e1-4a26-a797-bb176b731c25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:37:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Acquiring lock "cinder-quobyte-a146466c-a9c9-4445-904c-df09df60c837" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:37:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "cinder-quobyte-a146466c-a9c9-4445-904c-df09df60c837" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:37:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Acquiring lock "cinder-quobyte-4b4bb43c-20e1-4a26-a797-bb176b731c25" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:37:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "cinder-quobyte-4b4bb43c-20e1-4a26-a797-bb176b731c25" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:37:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Deleting offline snapshot 4b4bb43c-20e1-4a26-a797-bb176b731c25 of volume a146466c-a9c9-4445-904c-df09df60c837 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:37:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] snapshot_file for this snap is: volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:37:39 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[17885fe8-19ef-45ad-8b12-83a5e934ea6a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:37:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:39 devstack sudo[90402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25
Sep 16 08:37:39 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:39 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25" returned: 0 in 0.475s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a146466c-a9c9-4445-904c-df09df60c837(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:37:40 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bd36ce-2648-4ade-ae25-344754dbf9e6]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:37:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:40 devstack sudo[90408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837
Sep 16 08:37:40 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:40 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837" returned: 0 in 0.365s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:40 devstack sudo[90413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25
Sep 16 08:37:40 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:40 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25" returned: 0 in 0.392s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:40 devstack sudo[90420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25
Sep 16 08:37:40 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:41 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837.4b4bb43c-20e1-4a26-a797-bb176b731c25" returned: 0 in 0.279s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "cinder-quobyte-4b4bb43c-20e1-4a26-a797-bb176b731c25" released by "_delete_snapshot" :: held 1.663s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:37:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "cinder-quobyte-a146466c-a9c9-4445-904c-df09df60c837" released by "delete_snapshot" :: held 1.689s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:37:41 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Created reservations ['36a8361d-d7c8-4fd0-a1bd-044be9888684', 'df8b849f-c783-433f-8080-e44dda7ba1a5', 'f5f7e4c7-4830-4d9f-a787-4a19fe6d63d3', 'df0fd22d-a76a-490c-a19b-3174de46e7d4'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:37:41 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Delete snapshot completed successfully.
Sep 16 08:37:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-96e4cec1-f5c4-41aa-9bb8-08a0023bd9d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "cinder-4b4bb43c-20e1-4a26-a797-bb176b731c25-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:37:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Acquiring lock "cinder-a146466c-a9c9-4445-904c-df09df60c837-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:37:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "cinder-a146466c-a9c9-4445-904c-df09df60c837-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:37:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Acquiring lock "cinder-quobyte-a146466c-a9c9-4445-904c-df09df60c837" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:37:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "cinder-quobyte-a146466c-a9c9-4445-904c-df09df60c837" acquired by "delete_volume" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:37:41 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[52972226-696d-4dc6-b8f3-02542b3391cd]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:37:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:41 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837
Sep 16 08:37:41 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:42 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837" returned: 0 in 0.702s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:42 devstack sudo[90447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837
Sep 16 08:37:42 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:42 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a146466c-a9c9-4445-904c-df09df60c837" returned: 0 in 0.367s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "cinder-quobyte-a146466c-a9c9-4445-904c-df09df60c837" released by "delete_volume" :: held 1.157s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:37:42 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Created reservations ['82589baa-3d52-4a84-8c6d-e181664716a3', '26937ef7-a185-4f15-a974-31be69671975', 'ec259d5d-d184-4de8-8dec-301a0207fcea', 'fadb6dc3-5a4a-4596-82da-a23d261fc9b4'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:37:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:37:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:37:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:37:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:37:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:37:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:43 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:37:43 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:43 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.302s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:43 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:37:43 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Deleted volume successfully.
Sep 16 08:37:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-144c8765-df72-4abe-b3a2-bfaa1f7b0828 tempest-VolumeSnapshotQuotasNegativeTestJSON-2065134105 None] Lock "cinder-a146466c-a9c9-4445-904c-df09df60c837-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:37:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Acquiring lock "cinder-1e70a0da-725d-47eb-9167-709d77b5982a-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:37:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Lock "cinder-1e70a0da-725d-47eb-9167-709d77b5982a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:37:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Acquiring lock "cinder-quobyte-1e70a0da-725d-47eb-9167-709d77b5982a" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:37:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Lock "cinder-quobyte-1e70a0da-725d-47eb-9167-709d77b5982a" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:37:50 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[188894f7-978b-4875-8f36-d0fac3c1311b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:37:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e70a0da-725d-47eb-9167-709d77b5982a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:50 devstack sudo[90500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e70a0da-725d-47eb-9167-709d77b5982a
Sep 16 08:37:50 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:51 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e70a0da-725d-47eb-9167-709d77b5982a" returned: 0 in 0.513s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e70a0da-725d-47eb-9167-709d77b5982a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:51 devstack sudo[90516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e70a0da-725d-47eb-9167-709d77b5982a
Sep 16 08:37:51 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:51 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e70a0da-725d-47eb-9167-709d77b5982a" returned: 0 in 0.480s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Lock "cinder-quobyte-1e70a0da-725d-47eb-9167-709d77b5982a" released by "delete_volume" :: held 1.086s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:37:51 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Created reservations ['d1f9f41a-2b37-4319-8267-7cb84220d65b', '471635f1-389f-49ca-b664-3373be4398b9', '366e719b-eba3-401f-bf84-923dfb0dcc43', '42752ee7-1ab6-463d-9610-f8a558079b0c'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:52 devstack sudo[90524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:37:52 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:52 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.324s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:37:52 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Deleted volume successfully.
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5ef04f50-447d-47f6-a6e3-8d4efc2ff618 tempest-AttachVolumeShelveTestJSON-647534628 None] Lock "cinder-1e70a0da-725d-47eb-9167-709d77b5982a-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Flow 'volume_create_manager' (7fc3fc45-b76c-4901-a1fe-39dcc32bf712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb867909-7693-4bf3-96ca-6e675ee22886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb867909-7693-4bf3-96ca-6e675ee22886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2009879164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872ff532-cf81-4ff6-95d2-27458891bfc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba091db86c6148508d9998e5af0378ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:37:53Z,use_quota=True,user_id='cbe21084251e404a90d11ad1b398b5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3624771-1b87-44b5-98f0-9229fcd85a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3624771-1b87-44b5-98f0-9229fcd85a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3286bc-ac20-464d-bbab-4c26ca446f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:37:52 devstack cinder-volume[86261]: DEBUG cinder.image.glance [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Creating Keystone auth plugin from conf {{(pid=86261) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 08:37:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3286bc-ac20-464d-bbab-4c26ca446f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '872ff532-cf81-4ff6-95d2-27458891bfc8', 'volume_name': 'volume-872ff532-cf81-4ff6-95d2-27458891bfc8', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef3f6fc0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:37:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9c51c5-2961-4197-bd25-104822604b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:37:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9c51c5-2961-4197-bd25-104822604b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:37:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae21b97a-c70f-4526-8db2-88779b899a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:37:53 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Volume 872ff532-cf81-4ff6-95d2-27458891bfc8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-872ff532-cf81-4ff6-95d2-27458891bfc8', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef3f6fc0>}
Sep 16 08:37:53 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Trying to clone 872ff532-cf81-4ff6-95d2-27458891bfc8 from image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]). {{(pid=86261) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 08:37:53 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 08:37:53 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 08:37:53 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[43442a91-7471-4397-a5dc-ea56178185ae]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:37:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:54 devstack sudo[90561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD
Sep 16 08:37:54 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:54 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:54 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Temporary image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 is fetched for user cbe21084251e404a90d11ad1b398b5c9. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 08:37:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7796649b-e67c-40fc-bbb4-5dfb90ff83ba]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:37:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:54 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD
Sep 16 08:37:54 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:54 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:37:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:37:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2009879164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872ff532-cf81-4ff6-95d2-27458891bfc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba091db86c6148508d9998e5af0378ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:37:53Z,use_quota=True,user_id='cbe21084251e404a90d11ad1b398b5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:37:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Creating volume 872ff532-cf81-4ff6-95d2-27458891bfc8 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:37:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:37:55 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:55 devstack sudo[90590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8 1073741824
Sep 16 08:37:55 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:55 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8 1073741824" returned: 0 in 0.468s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:55 devstack sudo[90598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8
Sep 16 08:37:55 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:55 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8" returned: 0 in 0.274s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Attempting download of 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}])) to volume 872ff532-cf81-4ff6-95d2-27458891bfc8. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03cfcf5-6038-429a-ac9f-07f691d1c9e1]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:37:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_hzr6x3u_ {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:56 devstack sudo[90601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_hzr6x3u_
Sep 16 08:37:56 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:56 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_hzr6x3u_" returned: 0 in 0.365s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_hzr6x3u_ {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:56 devstack sudo[90605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_hzr6x3u_
Sep 16 08:37:56 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:56 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_hzr6x3u_" returned: 1 in 0.400s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_hzr6x3u_' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:37:56 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5352f2f6-e27f-4655-886d-69f688b48e48]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:37:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:56 devstack sudo[90611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD
Sep 16 08:37:56 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:37:57 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root
Sep 16 08:37:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD" returned: 0 in 0.546s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:37:57 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 was qcow2, converting to qcow2 {{(pid=86261) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 08:37:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:37:57 devstack sudo[90660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8
Sep 16 08:37:57 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:01 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8" returned: 0 in 4.608s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:01 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_tfmp5izadevstack@QuobyteHD, size 112.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:38:01 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Converted 112.00 MB image at 24.28 MB/s
Sep 16 08:38:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:01 devstack sudo[90760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8 1G
Sep 16 08:38:01 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:02 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8 1G" returned: 0 in 0.570s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:02 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Downloaded image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}])) to volume 872ff532-cf81-4ff6-95d2-27458891bfc8 successfully. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 08:38:02 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Temporary image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 for user cbe21084251e404a90d11ad1b398b5c9 is deleted. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 08:38:02 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Marking volume 872ff532-cf81-4ff6-95d2-27458891bfc8 as bootable. {{(pid=86261) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 08:38:02 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Copying metadata from image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 to 872ff532-cf81-4ff6-95d2-27458891bfc8. {{(pid=86261) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 08:38:02 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Creating volume glance metadata for volume 872ff532-cf81-4ff6-95d2-27458891bfc8 backed by image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86261) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 08:38:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae21b97a-c70f-4526-8db2-88779b899a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-872ff532-cf81-4ff6-95d2-27458891bfc8', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef3f6fc0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340b3137-561a-4432-803a-0d5e038bb9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:02 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Volume volume-872ff532-cf81-4ff6-95d2-27458891bfc8 (872ff532-cf81-4ff6-95d2-27458891bfc8): created successfully
Sep 16 08:38:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340b3137-561a-4432-803a-0d5e038bb9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Flow 'volume_create_manager' (7fc3fc45-b76c-4901-a1fe-39dcc32bf712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:02 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-53641219-55b7-4d29-af73-be4149bc5507 tempest-VolumesImageMetadata-909211579 None] Created volume successfully.
Sep 16 08:38:03 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Acquiring lock "cinder-872ff532-cf81-4ff6-95d2-27458891bfc8-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:04 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Lock "cinder-872ff532-cf81-4ff6-95d2-27458891bfc8-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:04 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Acquiring lock "cinder-quobyte-872ff532-cf81-4ff6-95d2-27458891bfc8" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:04 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Lock "cinder-quobyte-872ff532-cf81-4ff6-95d2-27458891bfc8" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:04 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9288c437-6f1d-43a3-aaa8-90fa7820cdb5]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:38:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:04 devstack sudo[90769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8
Sep 16 08:38:04 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:04 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8" returned: 0 in 0.597s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:04 devstack sudo[90775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8
Sep 16 08:38:04 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:05 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-872ff532-cf81-4ff6-95d2-27458891bfc8" returned: 0 in 0.424s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Lock "cinder-quobyte-872ff532-cf81-4ff6-95d2-27458891bfc8" released by "delete_volume" :: held 1.114s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:05 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Created reservations ['6650c2f7-fa17-4165-9901-d80ac06fcd74', 'f569c6cb-0a58-48b0-8ac6-cf4c22ea0b18', '926cbec8-b4a0-443b-a84a-638843ccd271', '6e67d6be-0b13-4d0e-b217-c6bc9491fe94'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:38:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:05 devstack sudo[90778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:38:05 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:05 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.345s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:05 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:38:05 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Deleted volume successfully.
Sep 16 08:38:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-02d5c2b6-dc56-4607-a51e-17c30693ef06 tempest-VolumesImageMetadata-909211579 None] Lock "cinder-872ff532-cf81-4ff6-95d2-27458891bfc8-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:38:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:12 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:38:12 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:13 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.411s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Flow 'volume_create_manager' (e23ebce9-0f19-485a-9fbd-9ce0148df3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d675d406-f72d-4ad6-900a-d20d6d764e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d675d406-f72d-4ad6-900a-d20d6d764e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-112052330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3061eb3162346f1bb61e3c3aaaef6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:13Z,use_quota=True,user_id='83a42309cd644699bf99239941a498e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44605d62-c251-4a63-9d33-910b8e74b91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44605d62-c251-4a63-9d33-910b8e74b91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b0be99-7beb-4aa1-a0a1-670e9b126b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b0be99-7beb-4aa1-a0a1-670e9b126b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff', 'volume_name': 'volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dce93fb-7fc9-45be-a4bf-245dd38fed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dce93fb-7fc9-45be-a4bf-245dd38fed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23c22c6-9acd-442b-ab79-389a3fff8814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:13 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Volume 88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff', 'volume_size': 1}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-112052330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3061eb3162346f1bb61e3c3aaaef6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:13Z,use_quota=True,user_id='83a42309cd644699bf99239941a498e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Creating volume 88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:38:13 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:38:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:13 devstack sudo[90812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff 1073741824
Sep 16 08:38:13 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:14 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff 1073741824" returned: 0 in 0.568s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:14 devstack sudo[90818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff
Sep 16 08:38:14 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:14 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff" returned: 0 in 0.283s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:38:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23c22c6-9acd-442b-ab79-389a3fff8814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d65581-8681-48cc-b823-d6e540940bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:14 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Volume volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff (88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff): created successfully
Sep 16 08:38:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d65581-8681-48cc-b823-d6e540940bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Flow 'volume_create_manager' (e23ebce9-0f19-485a-9fbd-9ce0148df3b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:14 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-dd9ea9da-1de1-4bd0-b8bf-378732fba590 tempest-SnapshotMetadataTestJSON-1281015944 None] Created volume successfully.
Sep 16 08:38:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] Creating offline snapshot 66241bb7-0e97-4597-82d2-f7ffd33c8004 of volume 88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:38:15 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c97ed9-43e6-4a83-ad65-0a33d9627bd0]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:38:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:15 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff
Sep 16 08:38:15 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:16 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff" returned: 0 in 0.390s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:16 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004 1G
Sep 16 08:38:16 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:16 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004 1G" returned: 0 in 0.415s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:16 devstack sudo[90859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004
Sep 16 08:38:16 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:16 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004" returned: 0 in 0.299s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:16 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004 is being set with open permissions: ugo+rw
Sep 16 08:38:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:16 devstack sudo[90864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004
Sep 16 08:38:16 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:17 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004" returned: 0 in 0.254s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:17 devstack sudo[90867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.info
Sep 16 08:38:17 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:17 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.info" returned: 0 in 0.268s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:17 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.info is being set with open permissions: ugo+rw
Sep 16 08:38:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:17 devstack sudo[90870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.info
Sep 16 08:38:17 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:17 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.info" returned: 0 in 0.272s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:17 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5b596df5-c569-4842-8d0f-dbfb6f5d943a tempest-SnapshotMetadataTestJSON-1281015944 None] Create snapshot completed successfully
Sep 16 08:38:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Acquiring lock "cinder-66241bb7-0e97-4597-82d2-f7ffd33c8004-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "cinder-66241bb7-0e97-4597-82d2-f7ffd33c8004-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Acquiring lock "cinder-quobyte-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "cinder-quobyte-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Acquiring lock "cinder-quobyte-66241bb7-0e97-4597-82d2-f7ffd33c8004" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "cinder-quobyte-66241bb7-0e97-4597-82d2-f7ffd33c8004" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Deleting offline snapshot 66241bb7-0e97-4597-82d2-f7ffd33c8004 of volume 88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:38:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] snapshot_file for this snap is: volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:38:19 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ae8e5b-b567-4e45-a88a-3d060d1e634d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:38:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:19 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004
Sep 16 08:38:19 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:20 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004" returned: 0 in 0.388s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:38:20 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ea5b2d-3c4a-4e32-9a28-615076321497]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:38:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:20 devstack sudo[90878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff
Sep 16 08:38:20 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:20 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff" returned: 0 in 0.399s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:20 devstack sudo[90884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004
Sep 16 08:38:20 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:21 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004" returned: 0 in 0.454s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:21 devstack sudo[90890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004
Sep 16 08:38:21 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:21 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff.66241bb7-0e97-4597-82d2-f7ffd33c8004" returned: 0 in 0.310s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "cinder-quobyte-66241bb7-0e97-4597-82d2-f7ffd33c8004" released by "_delete_snapshot" :: held 1.692s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "cinder-quobyte-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff" released by "delete_snapshot" :: held 1.719s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:21 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Created reservations ['cfb4a887-4a9e-43c0-b429-1f9c7a7f0901', '57b52ff2-b7c4-452e-a3c7-18c7bdee8bca', 'c5c04807-e69f-4f58-b250-c6c29cbe4f46', 'dd4b22a6-c322-4968-9328-052837d39204'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:38:21 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Delete snapshot completed successfully.
Sep 16 08:38:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c04d91fc-c85a-4548-b0df-6d4b9ce81f84 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "cinder-66241bb7-0e97-4597-82d2-f7ffd33c8004-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Acquiring lock "cinder-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "cinder-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Acquiring lock "cinder-quobyte-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "cinder-quobyte-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff" acquired by "delete_volume" :: waited 0.034s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:22 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8f7369-ace9-4da6-8559-4f1d407c15b8]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:38:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:22 devstack sudo[90893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff
Sep 16 08:38:22 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:22 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff" returned: 0 in 0.442s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:22 devstack sudo[90901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff
Sep 16 08:38:22 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:22 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff" returned: 0 in 0.265s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "cinder-quobyte-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff" released by "delete_volume" :: held 0.792s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:23 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Created reservations ['00027565-6aa9-49b2-a045-8ba8cfa980c9', 'aaa5efe5-d160-43c5-9d7e-3995e6ad008b', '81ff8cdd-a210-40fa-844e-d6d813e1ddbf', 'd388d3f4-8607-4e77-81e3-cf6b557eb4cb'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:38:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:23 devstack sudo[90906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:38:23 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:23 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.289s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:23 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:38:23 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Deleted volume successfully.
Sep 16 08:38:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c1d27ef5-cd76-4832-ae57-5a74787aff37 tempest-SnapshotMetadataTestJSON-1281015944 None] Lock "cinder-88e2bdd5-4373-47e8-9ae1-04d7f13bd2ff-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Flow 'volume_create_manager' (8940d2bb-f383-47b1-953f-fd056f9087d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b3d5e3-4a8b-4a8f-ac36-384e523705fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b3d5e3-4a8b-4a8f-ac36-384e523705fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1913923142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867fa8ab-d855-4f29-8a8f-0eeb037555a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4047803a140449e8dc3ccd8ba50edd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:26Z,use_quota=True,user_id='dd4761e024244422a517b0d013ab9983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad483d6-f4e2-4a74-a00f-7d55f6f02742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad483d6-f4e2-4a74-a00f-7d55f6f02742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7686ac04-b1eb-4ab6-bf54-388b0df3476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7686ac04-b1eb-4ab6-bf54-388b0df3476b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '867fa8ab-d855-4f29-8a8f-0eeb037555a9', 'volume_name': 'volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03ea608-bf56-4a72-851b-306901886d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03ea608-bf56-4a72-851b-306901886d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fed8bba-86fc-4b17-a6fa-02b3528038ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:25 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Volume 867fa8ab-d855-4f29-8a8f-0eeb037555a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9', 'volume_size': 1}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1913923142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867fa8ab-d855-4f29-8a8f-0eeb037555a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4047803a140449e8dc3ccd8ba50edd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:26Z,use_quota=True,user_id='dd4761e024244422a517b0d013ab9983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Creating volume 867fa8ab-d855-4f29-8a8f-0eeb037555a9 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:38:25 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:38:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:25 devstack sudo[90927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9 1073741824
Sep 16 08:38:25 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:26 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9 1073741824" returned: 0 in 0.623s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:26 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9
Sep 16 08:38:26 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:26 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9" returned: 0 in 0.367s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:38:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fed8bba-86fc-4b17-a6fa-02b3528038ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9042fb-c229-4e1f-a4b4-7aba229eb2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:26 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Volume volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9 (867fa8ab-d855-4f29-8a8f-0eeb037555a9): created successfully
Sep 16 08:38:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9042fb-c229-4e1f-a4b4-7aba229eb2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Flow 'volume_create_manager' (8940d2bb-f383-47b1-953f-fd056f9087d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:26 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-04d2b0ed-2e8b-4474-bf5c-40699d7796f3 tempest-ServerActionsTestOtherA-1577147641 None] Created volume successfully.
Sep 16 08:38:28 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Flow 'volume_create_manager' (032d022a-662e-4c82-b504-f672a8af0700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f7e52b-a310-467a-881a-3f3c18e4673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f7e52b-a310-467a-881a-3f3c18e4673a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-702170815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89c88cf-ead8-48ae-9ab6-fb88f48fd37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ded7620f37d44028d74b470d57baa4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:29Z,use_quota=True,user_id='34a28340f13148b781ebba95dabd62bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1252c57-e5b2-47b6-b857-b1dbac135096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1252c57-e5b2-47b6-b857-b1dbac135096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687e5134-341d-442b-9fe9-fac47b59ca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (687e5134-341d-442b-9fe9-fac47b59ca7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89c88cf-ead8-48ae-9ab6-fb88f48fd37a', 'volume_name': 'volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7411ff6-3e09-4b5c-99bd-5d38a7917940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7411ff6-3e09-4b5c-99bd-5d38a7917940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac34425-bcfc-4de2-b512-9b7866b9591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:29 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Volume a89c88cf-ead8-48ae-9ab6-fb88f48fd37a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a', 'volume_size': 1}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-702170815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89c88cf-ead8-48ae-9ab6-fb88f48fd37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ded7620f37d44028d74b470d57baa4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:29Z,use_quota=True,user_id='34a28340f13148b781ebba95dabd62bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Creating volume a89c88cf-ead8-48ae-9ab6-fb88f48fd37a {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:38:29 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:29 devstack sudo[91013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a 1073741824
Sep 16 08:38:29 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Flow 'volume_create_manager' (78a1d0c6-0803-4c2c-9828-8bc4d71edf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6e1ca5-c2f3-4053-96b6-5ac6c08b14f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6e1ca5-c2f3-4053-96b6-5ac6c08b14f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1715784384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073c0106-5617-40d3-8688-158dbcc51008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260a3e0dd1824744b9cb63554c4e9e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:29Z,use_quota=True,user_id='a6a0ee9756a9483d9eeddf327142da8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b4e077-b431-472e-bb29-7b1621e1de58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b4e077-b431-472e-bb29-7b1621e1de58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9bc2ad-4f25-4074-8aab-486564f002e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9bc2ad-4f25-4074-8aab-486564f002e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073c0106-5617-40d3-8688-158dbcc51008', 'volume_name': 'volume-073c0106-5617-40d3-8688-158dbcc51008', 'volume_size': 2}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090d9851-d6a3-49a1-9402-12250dabeb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090d9851-d6a3-49a1-9402-12250dabeb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82574f4d-2a91-40f5-91dc-db011de0de11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:29 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Volume 073c0106-5617-40d3-8688-158dbcc51008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073c0106-5617-40d3-8688-158dbcc51008', 'volume_size': 2}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:29 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a 1073741824" returned: 0 in 0.694s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:30 devstack sudo[91020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a
Sep 16 08:38:30 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:30 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a" returned: 0 in 0.268s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1715784384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073c0106-5617-40d3-8688-158dbcc51008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260a3e0dd1824744b9cb63554c4e9e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:29Z,use_quota=True,user_id='a6a0ee9756a9483d9eeddf327142da8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Creating volume 073c0106-5617-40d3-8688-158dbcc51008 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:38:30 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-073c0106-5617-40d3-8688-158dbcc51008 2147483648 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac34425-bcfc-4de2-b512-9b7866b9591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5b9151-cc07-4979-9e81-e1ae38575d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:30 devstack sudo[91023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-073c0106-5617-40d3-8688-158dbcc51008 2147483648
Sep 16 08:38:30 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:30 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Volume volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a (a89c88cf-ead8-48ae-9ab6-fb88f48fd37a): created successfully
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5b9151-cc07-4979-9e81-e1ae38575d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Flow 'volume_create_manager' (032d022a-662e-4c82-b504-f672a8af0700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8431874e-42c3-4c97-997e-9149730f537e tempest-AttachVolumeTestJSON-1675038212 None] Created volume successfully.
Sep 16 08:38:31 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-073c0106-5617-40d3-8688-158dbcc51008 2147483648" returned: 0 in 0.785s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-073c0106-5617-40d3-8688-158dbcc51008 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:31 devstack sudo[91038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-073c0106-5617-40d3-8688-158dbcc51008
Sep 16 08:38:31 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:31 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-073c0106-5617-40d3-8688-158dbcc51008" returned: 0 in 0.428s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:38:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:31 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=56,cinder:UPDATE=71,cinder:INSERT=24,cinder:DELETE=5 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:38:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82574f4d-2a91-40f5-91dc-db011de0de11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073c0106-5617-40d3-8688-158dbcc51008', 'volume_size': 2}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b677f0-0e77-4063-9671-504a0cafe600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:31 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=60,cinder:UPDATE=60,cinder:DELETE=6,cinder:INSERT=21 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:38:31 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Volume volume-073c0106-5617-40d3-8688-158dbcc51008 (073c0106-5617-40d3-8688-158dbcc51008): created successfully
Sep 16 08:38:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b677f0-0e77-4063-9671-504a0cafe600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Flow 'volume_create_manager' (78a1d0c6-0803-4c2c-9828-8bc4d71edf38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:31 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0324b328-362a-4e4a-82a3-54db002f6721 tempest-VolumesCloneNegativeTest-1316477508 None] Created volume successfully.
Sep 16 08:38:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Acquiring lock "cinder-073c0106-5617-40d3-8688-158dbcc51008-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Lock "cinder-073c0106-5617-40d3-8688-158dbcc51008-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-d5e165b5-e2bb-41ed-8008-97b9e77ca663 req-ad77b844-06ba-4dc4-bf66-cf2b677997b1 tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-d5e165b5-e2bb-41ed-8008-97b9e77ca663 req-ad77b844-06ba-4dc4-bf66-cf2b677997b1 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Acquiring lock "cinder-quobyte-073c0106-5617-40d3-8688-158dbcc51008" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-d5e165b5-e2bb-41ed-8008-97b9e77ca663 req-ad77b844-06ba-4dc4-bf66-cf2b677997b1 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Lock "cinder-quobyte-073c0106-5617-40d3-8688-158dbcc51008" acquired by "delete_volume" :: waited 0.033s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:32 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a998c789-717d-4932-b02e-f6fd6495a0a7]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:38:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-073c0106-5617-40d3-8688-158dbcc51008 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-d5e165b5-e2bb-41ed-8008-97b9e77ca663 req-ad77b844-06ba-4dc4-bf66-cf2b677997b1 tempest-AttachVolumeTestJSON-1675038212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f22e4edc-e4fd-4be4-8546-b4c8f047dd4a', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:38:32 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-d5e165b5-e2bb-41ed-8008-97b9e77ca663 req-ad77b844-06ba-4dc4-bf66-cf2b677997b1 tempest-AttachVolumeTestJSON-1675038212 None] attachment_update completed successfully.
Sep 16 08:38:32 devstack sudo[91051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-073c0106-5617-40d3-8688-158dbcc51008
Sep 16 08:38:32 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:33 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-073c0106-5617-40d3-8688-158dbcc51008" returned: 0 in 0.730s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-073c0106-5617-40d3-8688-158dbcc51008 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:33 devstack sudo[91152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-073c0106-5617-40d3-8688-158dbcc51008
Sep 16 08:38:33 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:33 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-073c0106-5617-40d3-8688-158dbcc51008" returned: 0 in 0.512s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Lock "cinder-quobyte-073c0106-5617-40d3-8688-158dbcc51008" released by "delete_volume" :: held 1.343s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:34 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Created reservations ['8c19a685-1522-4357-922a-546384e824e2', 'd2821677-940f-451b-858c-58e9f9293d84', '5b80686d-bb9d-43af-9f6b-43231b7ab25b', 'acba3b58-8643-495b-baa4-901329bcfce4'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:38:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:34 devstack sudo[91516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:38:34 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:34 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.418s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:34 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:38:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Deleted volume successfully.
Sep 16 08:38:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c02a3813-1918-450a-b295-0b2e3336285c tempest-VolumesCloneNegativeTest-1316477508 None] Lock "cinder-073c0106-5617-40d3-8688-158dbcc51008-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Flow 'volume_create_manager' (f63ae0cd-39c1-4709-97ce-67efb87954b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012eb40c-8d77-4065-87e2-e05ec0cc0c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012eb40c-8d77-4065-87e2-e05ec0cc0c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1645088056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450fbf75-6632-4c4a-97e3-449d72ec48d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ded7620f37d44028d74b470d57baa4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:37Z,use_quota=True,user_id='34a28340f13148b781ebba95dabd62bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b67e330-ff7c-4fa9-982f-ee4e9abdceac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b67e330-ff7c-4fa9-982f-ee4e9abdceac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08030cc2-625a-4118-bfee-ebdce79dce3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08030cc2-625a-4118-bfee-ebdce79dce3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '450fbf75-6632-4c4a-97e3-449d72ec48d3', 'volume_name': 'volume-450fbf75-6632-4c4a-97e3-449d72ec48d3', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafec1d4-bbb0-44c3-8bf4-99731a9580fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fafec1d4-bbb0-44c3-8bf4-99731a9580fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97df735c-8a7a-443d-a660-b1bebaeeee07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:36 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Volume 450fbf75-6632-4c4a-97e3-449d72ec48d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-450fbf75-6632-4c4a-97e3-449d72ec48d3', 'volume_size': 1}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1645088056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450fbf75-6632-4c4a-97e3-449d72ec48d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ded7620f37d44028d74b470d57baa4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:37Z,use_quota=True,user_id='34a28340f13148b781ebba95dabd62bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Creating volume 450fbf75-6632-4c4a-97e3-449d72ec48d3 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:38:36 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:38:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-450fbf75-6632-4c4a-97e3-449d72ec48d3 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:36 devstack sudo[91530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-450fbf75-6632-4c4a-97e3-449d72ec48d3 1073741824
Sep 16 08:38:36 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:37 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-450fbf75-6632-4c4a-97e3-449d72ec48d3 1073741824" returned: 0 in 0.586s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-450fbf75-6632-4c4a-97e3-449d72ec48d3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:37 devstack sudo[91536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-450fbf75-6632-4c4a-97e3-449d72ec48d3
Sep 16 08:38:37 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:37 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-450fbf75-6632-4c4a-97e3-449d72ec48d3" returned: 0 in 0.416s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:38:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97df735c-8a7a-443d-a660-b1bebaeeee07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-450fbf75-6632-4c4a-97e3-449d72ec48d3', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d118c465-6524-474b-b443-1c3b5c87df13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:37 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Volume volume-450fbf75-6632-4c4a-97e3-449d72ec48d3 (450fbf75-6632-4c4a-97e3-449d72ec48d3): created successfully
Sep 16 08:38:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d118c465-6524-474b-b443-1c3b5c87df13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Flow 'volume_create_manager' (f63ae0cd-39c1-4709-97ce-67efb87954b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7b916084-0ff0-4d70-b49d-60ff5ec168b2 tempest-AttachVolumeTestJSON-1675038212 None] Created volume successfully.
Sep 16 08:38:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-8362e946-93d4-4103-8a74-1813f113d6aa req-fa5d927f-8c2f-4e89-8257-95fdaeadb851 tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-8362e946-93d4-4103-8a74-1813f113d6aa req-fa5d927f-8c2f-4e89-8257-95fdaeadb851 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-8362e946-93d4-4103-8a74-1813f113d6aa req-fa5d927f-8c2f-4e89-8257-95fdaeadb851 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-8362e946-93d4-4103-8a74-1813f113d6aa req-fa5d927f-8c2f-4e89-8257-95fdaeadb851 tempest-AttachVolumeTestJSON-1675038212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-450fbf75-6632-4c4a-97e3-449d72ec48d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a9919a7-4132-476d-87e6-6e735af311a2', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:38:40 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-8362e946-93d4-4103-8a74-1813f113d6aa req-fa5d927f-8c2f-4e89-8257-95fdaeadb851 tempest-AttachVolumeTestJSON-1675038212 None] attachment_update completed successfully.
Sep 16 08:38:42 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:38:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Flow 'volume_create_manager' (77191c68-99d7-4d66-9bfc-bb299dbc86c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977fb09f-99b6-43f4-9ff7-c6b8481a9389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977fb09f-99b6-43f4-9ff7-c6b8481a9389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-593816779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8b9b1df94eb494fa84ff7710f4594a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:43Z,use_quota=True,user_id='fa763934dd1046bca28d24aec28f67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3210792-e59f-405a-ac34-64e066813cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3210792-e59f-405a-ac34-64e066813cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed5ba6c-3b06-4867-93d1-6152efb0f9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed5ba6c-3b06-4867-93d1-6152efb0f9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18', 'volume_name': 'volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dc5e07-63c1-4ed3-be19-8d179a4eccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dc5e07-63c1-4ed3-be19-8d179a4eccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2692c4b-a3e1-416a-8608-9019615d450a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:43 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Volume a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18', 'volume_size': 1}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-593816779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8b9b1df94eb494fa84ff7710f4594a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:43Z,use_quota=True,user_id='fa763934dd1046bca28d24aec28f67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Creating volume a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:38:43 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:38:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:43 devstack sudo[91636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18 1073741824
Sep 16 08:38:43 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:44 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18 1073741824" returned: 0 in 0.958s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:44 devstack sudo[91662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18
Sep 16 08:38:44 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:44 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-40da95e0-1acf-4a27-9b0c-be9f7a59c1bc req-94969433-ea63-4a9e-969b-b59e2def9548 tempest-AttachVolumeTestJSON-1675038212 None] Terminate volume connection completed successfully.
Sep 16 08:38:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-40da95e0-1acf-4a27-9b0c-be9f7a59c1bc req-94969433-ea63-4a9e-969b-b59e2def9548 tempest-AttachVolumeTestJSON-1675038212 None] Deleting attachment f22e4edc-e4fd-4be4-8546-b4c8f047dd4a. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:38:44 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18" returned: 0 in 0.395s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:38:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2692c4b-a3e1-416a-8608-9019615d450a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a95681-4e94-4430-9b88-9c1871bcdd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:44 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Volume volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18 (a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18): created successfully
Sep 16 08:38:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a95681-4e94-4430-9b88-9c1871bcdd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Flow 'volume_create_manager' (77191c68-99d7-4d66-9bfc-bb299dbc86c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:44 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-afdf2749-3e56-42cd-bbad-c75e8d2c940b tempest-VolumesListTestJSON-829485517 None] Created volume successfully.
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Flow 'volume_create_manager' (282af9bb-fd0e-4ff0-b4f5-8e7279262d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba6b339a-f367-4a7d-bc15-2b876e51d361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba6b339a-f367-4a7d-bc15-2b876e51d361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1541702947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8119d61d-1a39-4412-907c-19a8732a173c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8b9b1df94eb494fa84ff7710f4594a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:46Z,use_quota=True,user_id='fa763934dd1046bca28d24aec28f67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30c6f41-be6f-4b1b-b7e7-16a0d60a3824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30c6f41-be6f-4b1b-b7e7-16a0d60a3824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a494fd0f-71b7-480e-b17a-bb24e6729163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a494fd0f-71b7-480e-b17a-bb24e6729163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8119d61d-1a39-4412-907c-19a8732a173c', 'volume_name': 'volume-8119d61d-1a39-4412-907c-19a8732a173c', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efff514-f922-4b56-95cb-25462b96ff71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efff514-f922-4b56-95cb-25462b96ff71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7584a0a3-bd93-4d47-b567-d80ed3d6506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:45 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Volume 8119d61d-1a39-4412-907c-19a8732a173c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8119d61d-1a39-4412-907c-19a8732a173c', 'volume_size': 1}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1541702947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8119d61d-1a39-4412-907c-19a8732a173c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8b9b1df94eb494fa84ff7710f4594a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:46Z,use_quota=True,user_id='fa763934dd1046bca28d24aec28f67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Creating volume 8119d61d-1a39-4412-907c-19a8732a173c {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:38:45 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8119d61d-1a39-4412-907c-19a8732a173c 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:45 devstack sudo[91709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8119d61d-1a39-4412-907c-19a8732a173c 1073741824
Sep 16 08:38:45 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:45 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-745c2b9f-457d-4bad-b9fe-b0cf862f00e5 req-773aca20-9348-408d-93a3-40d7693628eb tempest-AttachVolumeTestJSON-1675038212 None] Terminate volume connection completed successfully.
Sep 16 08:38:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-745c2b9f-457d-4bad-b9fe-b0cf862f00e5 req-773aca20-9348-408d-93a3-40d7693628eb tempest-AttachVolumeTestJSON-1675038212 None] Deleting attachment 1a9919a7-4132-476d-87e6-6e735af311a2. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:38:46 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8119d61d-1a39-4412-907c-19a8732a173c 1073741824" returned: 0 in 0.585s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8119d61d-1a39-4412-907c-19a8732a173c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:46 devstack sudo[91715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8119d61d-1a39-4412-907c-19a8732a173c
Sep 16 08:38:46 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:46 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8119d61d-1a39-4412-907c-19a8732a173c" returned: 0 in 0.297s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:38:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7584a0a3-bd93-4d47-b567-d80ed3d6506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8119d61d-1a39-4412-907c-19a8732a173c', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b789c1ec-0560-4e12-ac38-d5c722b98983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:46 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Volume volume-8119d61d-1a39-4412-907c-19a8732a173c (8119d61d-1a39-4412-907c-19a8732a173c): created successfully
Sep 16 08:38:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b789c1ec-0560-4e12-ac38-d5c722b98983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Flow 'volume_create_manager' (282af9bb-fd0e-4ff0-b4f5-8e7279262d03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:46 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b7b81469-9896-4806-9889-14da42a9c785 tempest-VolumesListTestJSON-829485517 None] Created volume successfully.
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Flow 'volume_create_manager' (55c09174-f9c9-465e-8ec5-9fcbd88507e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434b3750-168d-418a-9c12-b206e32438aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434b3750-168d-418a-9c12-b206e32438aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1927810571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f704d10e-b58a-4595-9167-ae20130e4bb2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8b9b1df94eb494fa84ff7710f4594a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:48Z,use_quota=True,user_id='fa763934dd1046bca28d24aec28f67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca6e340-b486-4010-bea0-dc63e06f6980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca6e340-b486-4010-bea0-dc63e06f6980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3d2389-b32b-440c-ae1f-dec4e7211387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3d2389-b32b-440c-ae1f-dec4e7211387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f704d10e-b58a-4595-9167-ae20130e4bb2', 'volume_name': 'volume-f704d10e-b58a-4595-9167-ae20130e4bb2', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2078da34-6abc-4913-af53-582c0df244d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2078da34-6abc-4913-af53-582c0df244d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ddc724-751d-4cb8-93aa-ecab2b27c42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:48 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Volume f704d10e-b58a-4595-9167-ae20130e4bb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f704d10e-b58a-4595-9167-ae20130e4bb2', 'volume_size': 1}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1927810571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f704d10e-b58a-4595-9167-ae20130e4bb2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8b9b1df94eb494fa84ff7710f4594a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:48Z,use_quota=True,user_id='fa763934dd1046bca28d24aec28f67b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Creating volume f704d10e-b58a-4595-9167-ae20130e4bb2 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:38:48 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:38:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f704d10e-b58a-4595-9167-ae20130e4bb2 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:48 devstack sudo[91742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f704d10e-b58a-4595-9167-ae20130e4bb2 1073741824
Sep 16 08:38:48 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:49 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f704d10e-b58a-4595-9167-ae20130e4bb2 1073741824" returned: 0 in 0.544s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f704d10e-b58a-4595-9167-ae20130e4bb2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:49 devstack sudo[91749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f704d10e-b58a-4595-9167-ae20130e4bb2
Sep 16 08:38:49 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:49 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f704d10e-b58a-4595-9167-ae20130e4bb2" returned: 0 in 0.275s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:49 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:38:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ddc724-751d-4cb8-93aa-ecab2b27c42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f704d10e-b58a-4595-9167-ae20130e4bb2', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85794dc6-7d63-42ed-ac81-a483da89213f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:49 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Volume volume-f704d10e-b58a-4595-9167-ae20130e4bb2 (f704d10e-b58a-4595-9167-ae20130e4bb2): created successfully
Sep 16 08:38:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85794dc6-7d63-42ed-ac81-a483da89213f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Flow 'volume_create_manager' (55c09174-f9c9-465e-8ec5-9fcbd88507e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:49 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9f9ae532-6fc9-45f0-84a0-d849d5bca77b tempest-VolumesListTestJSON-829485517 None] Created volume successfully.
Sep 16 08:38:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "cinder-450fbf75-6632-4c4a-97e3-449d72ec48d3-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Lock "cinder-450fbf75-6632-4c4a-97e3-449d72ec48d3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "cinder-quobyte-450fbf75-6632-4c4a-97e3-449d72ec48d3" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Lock "cinder-quobyte-450fbf75-6632-4c4a-97e3-449d72ec48d3" acquired by "delete_volume" :: waited 0.040s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:51 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[737ac150-01b5-4802-98f1-985fae2a2757]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:38:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-450fbf75-6632-4c4a-97e3-449d72ec48d3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:51 devstack sudo[91753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-450fbf75-6632-4c4a-97e3-449d72ec48d3
Sep 16 08:38:51 devstack sudo[91753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:51 devstack sudo[91753]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-450fbf75-6632-4c4a-97e3-449d72ec48d3" returned: 0 in 0.430s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-450fbf75-6632-4c4a-97e3-449d72ec48d3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:51 devstack sudo[91759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-450fbf75-6632-4c4a-97e3-449d72ec48d3
Sep 16 08:38:51 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:52 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-450fbf75-6632-4c4a-97e3-449d72ec48d3" returned: 0 in 0.297s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Lock "cinder-quobyte-450fbf75-6632-4c4a-97e3-449d72ec48d3" released by "delete_volume" :: held 0.801s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Created reservations ['55b41603-027c-4a1f-a405-348065456afd', 'f1ac116b-7180-401d-b01c-a7ba4924bab7', '066d59bd-5f32-47e2-9b41-afaf3eaaab4c', '1b7260e7-cdf3-4c64-950a-27d491eb685c'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:52 devstack sudo[91762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:38:52 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "cinder-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Lock "cinder-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "cinder-quobyte-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Lock "cinder-quobyte-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a" acquired by "delete_volume" :: waited 0.051s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:52 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.416s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:38:52 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Deleted volume successfully.
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[985d0a43-e5c3-42a9-8019-3cba3a598366]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9872259e-6f15-43c2-b059-bd8ef93e5ebb tempest-AttachVolumeTestJSON-1675038212 None] Lock "cinder-450fbf75-6632-4c4a-97e3-449d72ec48d3-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:52 devstack sudo[91765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a
Sep 16 08:38:52 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:53 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a" returned: 0 in 0.439s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:53 devstack sudo[91770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a
Sep 16 08:38:53 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:53 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a" returned: 0 in 0.267s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Lock "cinder-quobyte-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a" released by "delete_volume" :: held 0.782s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Created reservations ['c5c90363-67e0-4b2d-afe9-dd84600c0887', 'ee29ad5f-b1e8-4ad9-aa9d-9618355dac44', 'fb941554-5cc2-4fa3-acb1-49860e63383a', '3d25c8ee-173f-4930-915c-db9efd46aade'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:53 devstack sudo[91781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:38:53 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:53 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.312s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:38:53 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Deleted volume successfully.
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0e9ea96f-ec5c-4aed-bfc5-d3416548c61e tempest-AttachVolumeTestJSON-1675038212 None] Lock "cinder-a89c88cf-ead8-48ae-9ab6-fb88f48fd37a-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "cinder-c64b76de-02d9-4121-91f5-eb14ed6cb8cc-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Lock "cinder-c64b76de-02d9-4121-91f5-eb14ed6cb8cc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "cinder-quobyte-c64b76de-02d9-4121-91f5-eb14ed6cb8cc" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Lock "cinder-quobyte-c64b76de-02d9-4121-91f5-eb14ed6cb8cc" acquired by "delete_volume" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[13313121-3630-4cd8-91dc-876d281f82b6]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:54 devstack sudo[91784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc
Sep 16 08:38:54 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Acquiring lock "cinder-f704d10e-b58a-4595-9167-ae20130e4bb2-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Lock "cinder-f704d10e-b58a-4595-9167-ae20130e4bb2-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Acquiring lock "cinder-quobyte-f704d10e-b58a-4595-9167-ae20130e4bb2" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Lock "cinder-quobyte-f704d10e-b58a-4595-9167-ae20130e4bb2" acquired by "delete_volume" :: waited 0.033s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c2d91a-91ac-4cfe-8d45-ecfcd56798c8]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f704d10e-b58a-4595-9167-ae20130e4bb2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:54 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc" returned: 0 in 0.506s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:54 devstack sudo[91791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc
Sep 16 08:38:54 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:54 devstack sudo[91788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f704d10e-b58a-4595-9167-ae20130e4bb2
Sep 16 08:38:54 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Flow 'volume_create_manager' (0a08d4c1-1442-4510-8126-c3ba2b390180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c74df2f-ddb1-4313-939b-7d8841723aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c74df2f-ddb1-4313-939b-7d8841723aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-722340219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532ee01c-8510-4374-bbc6-82052c0a5fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72d2a7e1cac40db8fd520d924406b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:55Z,use_quota=True,user_id='9a6b2551947e49e480c7ebb2449af26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483553e6-7546-477c-9352-429e09893348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483553e6-7546-477c-9352-429e09893348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae71d34c-f9a6-4f02-b018-61739b6b2e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae71d34c-f9a6-4f02-b018-61739b6b2e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532ee01c-8510-4374-bbc6-82052c0a5fd8', 'volume_name': 'volume-532ee01c-8510-4374-bbc6-82052c0a5fd8', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdb9760-50ee-4de9-b0a2-594c747e4eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdb9760-50ee-4de9-b0a2-594c747e4eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51152c84-71e3-49fa-830c-a11f66aeba70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:54 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Volume 532ee01c-8510-4374-bbc6-82052c0a5fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532ee01c-8510-4374-bbc6-82052c0a5fd8', 'volume_size': 1}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-722340219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532ee01c-8510-4374-bbc6-82052c0a5fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72d2a7e1cac40db8fd520d924406b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:38:55Z,use_quota=True,user_id='9a6b2551947e49e480c7ebb2449af26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Creating volume 532ee01c-8510-4374-bbc6-82052c0a5fd8 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:38:54 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-532ee01c-8510-4374-bbc6-82052c0a5fd8 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:54 devstack sudo[91794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-532ee01c-8510-4374-bbc6-82052c0a5fd8 1073741824
Sep 16 08:38:54 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:54 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c64b76de-02d9-4121-91f5-eb14ed6cb8cc" returned: 0 in 0.305s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Lock "cinder-quobyte-c64b76de-02d9-4121-91f5-eb14ed6cb8cc" released by "delete_volume" :: held 0.875s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:54 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f704d10e-b58a-4595-9167-ae20130e4bb2" returned: 0 in 0.454s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f704d10e-b58a-4595-9167-ae20130e4bb2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:54 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Created reservations ['d61850a5-4725-47a2-825f-33f9ab1d8ef6', '2d5642b1-fd20-4357-8666-1d59a20d26cf', 'f117b5ba-0b84-4602-9435-51604e7e90bb', 'd899850c-b64f-4daf-95a6-88d3d72a3622'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:38:55 devstack sudo[91801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f704d10e-b58a-4595-9167-ae20130e4bb2
Sep 16 08:38:55 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:55 devstack sudo[91803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:38:55 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:55 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f704d10e-b58a-4595-9167-ae20130e4bb2" returned: 0 in 0.370s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Lock "cinder-quobyte-f704d10e-b58a-4595-9167-ae20130e4bb2" released by "delete_volume" :: held 0.889s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:55 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.355s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:38:55 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Deleted volume successfully.
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Created reservations ['7ac58b4e-570b-4f87-876b-f1f7a76a5e8a', '79c54654-faee-456c-8369-9b4f40aaa185', '7a01cc3a-17c1-4234-983c-c3dcd948b0da', '9ca57ab2-066e-41ab-a786-72db3867018a'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f9368394-25b8-4b14-9753-4f61dd08b8d2 tempest-AttachVolumeTestJSON-1675038212 None] Lock "cinder-c64b76de-02d9-4121-91f5-eb14ed6cb8cc-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:55 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-532ee01c-8510-4374-bbc6-82052c0a5fd8 1073741824" returned: 0 in 0.740s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-532ee01c-8510-4374-bbc6-82052c0a5fd8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:55 devstack sudo[91850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:38:55 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:55 devstack sudo[91851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-532ee01c-8510-4374-bbc6-82052c0a5fd8
Sep 16 08:38:55 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Acquiring lock "cinder-8119d61d-1a39-4412-907c-19a8732a173c-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Lock "cinder-8119d61d-1a39-4412-907c-19a8732a173c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Acquiring lock "cinder-quobyte-8119d61d-1a39-4412-907c-19a8732a173c" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Lock "cinder-quobyte-8119d61d-1a39-4412-907c-19a8732a173c" acquired by "delete_volume" :: waited 0.056s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d22b1f4-4ac7-401a-90bd-5160f926e01e]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8119d61d-1a39-4412-907c-19a8732a173c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:56 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.432s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:38:56 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:56 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Deleted volume successfully.
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-532ee01c-8510-4374-bbc6-82052c0a5fd8" returned: 0 in 0.434s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51152c84-71e3-49fa-830c-a11f66aeba70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532ee01c-8510-4374-bbc6-82052c0a5fd8', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbcd5a5-8889-4060-980c-3dc5a5f7a550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:38:56 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Volume volume-532ee01c-8510-4374-bbc6-82052c0a5fd8 (532ee01c-8510-4374-bbc6-82052c0a5fd8): created successfully
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbcd5a5-8889-4060-980c-3dc5a5f7a550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Flow 'volume_create_manager' (0a08d4c1-1442-4510-8126-c3ba2b390180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-740d86f0-222a-49bb-a279-47ec1bc746d3 tempest-VolumesListTestJSON-829485517 None] Lock "cinder-f704d10e-b58a-4595-9167-ae20130e4bb2-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:56 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2909ca38-cd85-4fdc-91ef-f47d33f96e56 tempest-AttachVolumeNegativeTest-2009469181 None] Created volume successfully.
Sep 16 08:38:56 devstack sudo[91856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8119d61d-1a39-4412-907c-19a8732a173c
Sep 16 08:38:56 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:56 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8119d61d-1a39-4412-907c-19a8732a173c" returned: 0 in 0.442s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8119d61d-1a39-4412-907c-19a8732a173c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:56 devstack sudo[91862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8119d61d-1a39-4412-907c-19a8732a173c
Sep 16 08:38:56 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:56 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8119d61d-1a39-4412-907c-19a8732a173c" returned: 0 in 0.297s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Lock "cinder-quobyte-8119d61d-1a39-4412-907c-19a8732a173c" released by "delete_volume" :: held 0.832s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Created reservations ['f097da2e-681c-4d48-9075-f721fac90aa1', '64f4c845-708c-4117-9199-eb65e31e382b', '908dab77-170b-4a44-9762-0e92b66a2f25', '32dcbcb4-45f7-4759-8a80-c67ec8086176'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:57 devstack sudo[91869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:38:57 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Acquiring lock "cinder-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Lock "cinder-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Acquiring lock "cinder-quobyte-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Lock "cinder-quobyte-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23c0f23-efd6-45d2-b193-5c23111339c2]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:57 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.402s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:38:57 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Deleted volume successfully.
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4169339f-cda4-4c66-ab62-96d79f0a5656 tempest-VolumesListTestJSON-829485517 None] Lock "cinder-8119d61d-1a39-4412-907c-19a8732a173c-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:57 devstack sudo[91873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18
Sep 16 08:38:57 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-bf402dad-47e1-4055-85d9-a58a77c9aa16 req-f7e08313-5846-4162-b993-dc6e97459857 tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-bf402dad-47e1-4055-85d9-a58a77c9aa16 req-f7e08313-5846-4162-b993-dc6e97459857 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-bf402dad-47e1-4055-85d9-a58a77c9aa16 req-f7e08313-5846-4162-b993-dc6e97459857 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-bf402dad-47e1-4055-85d9-a58a77c9aa16 req-f7e08313-5846-4162-b993-dc6e97459857 tempest-AttachVolumeNegativeTest-2009469181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-532ee01c-8510-4374-bbc6-82052c0a5fd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18827c97-4112-451b-85e0-86007d00947d', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:38:57 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-bf402dad-47e1-4055-85d9-a58a77c9aa16 req-f7e08313-5846-4162-b993-dc6e97459857 tempest-AttachVolumeNegativeTest-2009469181 None] attachment_update completed successfully.
Sep 16 08:38:57 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18" returned: 0 in 0.446s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:57 devstack sudo[91887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18
Sep 16 08:38:57 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:58 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18" returned: 0 in 0.312s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Lock "cinder-quobyte-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18" released by "delete_volume" :: held 0.818s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:38:58 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Created reservations ['9f5b385f-8aa6-4755-adce-95a53e3ac465', '00bc3e3f-0b8d-42d0-8450-febd629d5862', '56a669f4-2982-4fd4-8e29-ab741285aa89', '673e8288-dadb-420a-af11-5a06c1e9a2b8'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:38:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:38:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:38:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:38:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:38:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:38:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:38:58 devstack sudo[92302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:38:58 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:38:58 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root
Sep 16 08:38:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.313s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:38:58 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:38:58 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Deleted volume successfully.
Sep 16 08:38:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eaaf8e29-9d70-4156-83cc-3dedde0a907a tempest-VolumesListTestJSON-829485517 None] Lock "cinder-a6c0db9e-7ccd-4a9d-a160-aa0861f3cb18-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Flow 'volume_create_manager' (ff3f36b9-bf48-4f8f-83e4-063f475a1357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b58c16-fd67-4918-9edc-0b9bc93f8e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b58c16-fd67-4918-9edc-0b9bc93f8e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1085328146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4930c6f0-3337-45dc-b011-d3126cfc59ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0d85e59f2040bcb573097f368d4a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:39:03Z,use_quota=True,user_id='a6d9d3a319bb4482bfc4e448d78aa0bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbad8dfc-9e6d-4910-aea9-2e30ba2f177a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbad8dfc-9e6d-4910-aea9-2e30ba2f177a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d55293c-b713-4f9d-b0e2-955f7a96d9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d55293c-b713-4f9d-b0e2-955f7a96d9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4930c6f0-3337-45dc-b011-d3126cfc59ef', 'volume_name': 'volume-4930c6f0-3337-45dc-b011-d3126cfc59ef', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7902e6a8-11c9-491e-865f-72ad013a2c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7902e6a8-11c9-491e-865f-72ad013a2c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7d93ad-becf-46a8-bf2b-687dd54689ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:03 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Volume 4930c6f0-3337-45dc-b011-d3126cfc59ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4930c6f0-3337-45dc-b011-d3126cfc59ef', 'volume_size': 1}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1085328146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4930c6f0-3337-45dc-b011-d3126cfc59ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f0d85e59f2040bcb573097f368d4a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:39:03Z,use_quota=True,user_id='a6d9d3a319bb4482bfc4e448d78aa0bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Creating volume 4930c6f0-3337-45dc-b011-d3126cfc59ef {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:39:03 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4930c6f0-3337-45dc-b011-d3126cfc59ef 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:03 devstack sudo[92312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4930c6f0-3337-45dc-b011-d3126cfc59ef 1073741824
Sep 16 08:39:03 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:03 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4930c6f0-3337-45dc-b011-d3126cfc59ef 1073741824" returned: 0 in 0.577s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4930c6f0-3337-45dc-b011-d3126cfc59ef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:04 devstack sudo[92320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4930c6f0-3337-45dc-b011-d3126cfc59ef
Sep 16 08:39:04 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:04 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4930c6f0-3337-45dc-b011-d3126cfc59ef" returned: 0 in 0.395s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:39:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:39:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7d93ad-becf-46a8-bf2b-687dd54689ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4930c6f0-3337-45dc-b011-d3126cfc59ef', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd2741d-6a0a-4d59-af25-ebe4005d7db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:04 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Volume volume-4930c6f0-3337-45dc-b011-d3126cfc59ef (4930c6f0-3337-45dc-b011-d3126cfc59ef): created successfully
Sep 16 08:39:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd2741d-6a0a-4d59-af25-ebe4005d7db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Flow 'volume_create_manager' (ff3f36b9-bf48-4f8f-83e4-063f475a1357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:39:04 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8001be66-abeb-4212-86eb-243e5ad4b634 tempest-VolumesNegativeTest-1398455808 None] Created volume successfully.
Sep 16 08:39:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-e6a77919-7489-4381-a045-760a5f71bc66 req-af9f5d2a-2a08-4d30-ab4b-87fc29bb2d9f tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:39:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-e6a77919-7489-4381-a045-760a5f71bc66 req-af9f5d2a-2a08-4d30-ab4b-87fc29bb2d9f tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:39:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-e6a77919-7489-4381-a045-760a5f71bc66 req-af9f5d2a-2a08-4d30-ab4b-87fc29bb2d9f tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:39:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-e6a77919-7489-4381-a045-760a5f71bc66 req-af9f5d2a-2a08-4d30-ab4b-87fc29bb2d9f tempest-ServerActionsTestOtherA-1577147641 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6eb0f561-53d2-40b0-a3ca-329a9efed93a', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:39:10 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-e6a77919-7489-4381-a045-760a5f71bc66 req-af9f5d2a-2a08-4d30-ab4b-87fc29bb2d9f tempest-ServerActionsTestOtherA-1577147641 None] attachment_update completed successfully.
Sep 16 08:39:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:39:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:39:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:39:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:39:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:39:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:39:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:12 devstack sudo[92422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:39:12 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:13 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.567s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:39:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:39:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:39:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:39:15 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-023881ed-9d3b-43db-99aa-edb317b6f10a req-a0bb069d-d197-4af1-b8fc-bce815dcd2cf tempest-ServerActionsTestOtherA-1577147641 None] Terminate volume connection completed successfully.
Sep 16 08:39:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-023881ed-9d3b-43db-99aa-edb317b6f10a req-a0bb069d-d197-4af1-b8fc-bce815dcd2cf tempest-ServerActionsTestOtherA-1577147641 None] Deleting attachment 6eb0f561-53d2-40b0-a3ca-329a9efed93a. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:39:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-023881ed-9d3b-43db-99aa-edb317b6f10a req-aade4ed0-fc86-4d9f-bee9-548f4c34f70d tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:39:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-023881ed-9d3b-43db-99aa-edb317b6f10a req-aade4ed0-fc86-4d9f-bee9-548f4c34f70d tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:39:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-023881ed-9d3b-43db-99aa-edb317b6f10a req-aade4ed0-fc86-4d9f-bee9-548f4c34f70d tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:39:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-023881ed-9d3b-43db-99aa-edb317b6f10a req-aade4ed0-fc86-4d9f-bee9-548f4c34f70d tempest-ServerActionsTestOtherA-1577147641 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5c0e9f5-d109-4f8a-9044-17f6cdaabea0', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:39:19 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-023881ed-9d3b-43db-99aa-edb317b6f10a req-aade4ed0-fc86-4d9f-bee9-548f4c34f70d tempest-ServerActionsTestOtherA-1577147641 None] attachment_update completed successfully.
Sep 16 08:39:20 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-85342ade-41b3-4385-9661-0954f44f0b1c tempest-GroupsV314Test-860050458 None] Group tempest-GroupsV314Test-Group-147197698: creating
Sep 16 08:39:20 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-85342ade-41b3-4385-9661-0954f44f0b1c tempest-GroupsV314Test-860050458 None] Group tempest-GroupsV314Test-Group-147197698: created successfully
Sep 16 08:39:20 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-85342ade-41b3-4385-9661-0954f44f0b1c tempest-GroupsV314Test-860050458 None] Create group completed successfully.
Sep 16 08:39:22 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:39:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Flow 'volume_create_manager' (59217482-9db4-43e9-905a-7fdd8fbcf7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:39:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26a813b-c4bf-4c5c-8bca-edaf52dcffb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26a813b-c4bf-4c5c-8bca-edaf52dcffb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1698666342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a156d622-9909-411d-8948-92a1708538ad,host='devstack@QuobyteHD#QuobyteHD',id=7044ec13-41a9-4149-868d-5c6bce556280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81aca4f816614839bd65160bacc92454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:39:23Z,use_quota=True,user_id='a2482dcb01124a0385242d547987cd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66911092-269d-4e39-8416-84731a7f153c),volume_type_id=66911092-269d-4e39-8416-84731a7f153c)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48b67b7-eb76-459d-a6f3-02bc12a86c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48b67b7-eb76-459d-a6f3-02bc12a86c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cc6f5c-8db7-4385-a3f7-d8ffa6198a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cc6f5c-8db7-4385-a3f7-d8ffa6198a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7044ec13-41a9-4149-868d-5c6bce556280', 'volume_name': 'volume-7044ec13-41a9-4149-868d-5c6bce556280', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c3fd2a-3fb3-43a3-a9d7-451c4bd68f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c3fd2a-3fb3-43a3-a9d7-451c4bd68f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b691c5a-964d-4073-be91-60b71ebe0d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:23 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Volume 7044ec13-41a9-4149-868d-5c6bce556280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7044ec13-41a9-4149-868d-5c6bce556280', 'volume_size': 1}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a156d622-9909-411d-8948-92a1708538ad,created_at=2026-09-16T06:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1698666342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a156d622-9909-411d-8948-92a1708538ad,host='devstack@QuobyteHD#QuobyteHD',id=7044ec13-41a9-4149-868d-5c6bce556280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81aca4f816614839bd65160bacc92454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:39:23Z,use_quota=True,user_id='a2482dcb01124a0385242d547987cd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66911092-269d-4e39-8416-84731a7f153c),volume_type_id=66911092-269d-4e39-8416-84731a7f153c)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Creating volume 7044ec13-41a9-4149-868d-5c6bce556280 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:39:23 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:23 devstack sudo[92638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 1073741824
Sep 16 08:39:23 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:23 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 1073741824" returned: 0 in 0.668s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:23 devstack sudo[92659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280
Sep 16 08:39:23 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:24 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280" returned: 0 in 0.313s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:39:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:39:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b691c5a-964d-4073-be91-60b71ebe0d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7044ec13-41a9-4149-868d-5c6bce556280', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d915fb33-7ccd-4ef3-a708-fcb9916814f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:24 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Volume volume-7044ec13-41a9-4149-868d-5c6bce556280 (7044ec13-41a9-4149-868d-5c6bce556280): created successfully
Sep 16 08:39:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d915fb33-7ccd-4ef3-a708-fcb9916814f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Flow 'volume_create_manager' (59217482-9db4-43e9-905a-7fdd8fbcf7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:39:24 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e90d318e-e4ca-4545-bf64-a46150995b26 tempest-GroupsV314Test-860050458 None] Created volume successfully.
Sep 16 08:39:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:39:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:39:25 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Cloning volume 7044ec13-41a9-4149-868d-5c6bce556280 to volume c3b66248-20fa-4525-9b09-ca37da07991b
Sep 16 08:39:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Creating offline snapshot 3807f9f2-0cb5-46d1-96a4-97e726adf5a6 of volume 7044ec13-41a9-4149-868d-5c6bce556280 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:39:25 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38f5f14-970c-4d78-826d-c01f701487d7]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:39:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:26 devstack sudo[92689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280
Sep 16 08:39:26 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:26 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280" returned: 0 in 0.474s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:26 devstack sudo[92694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6 1G
Sep 16 08:39:26 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:26 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6 1G" returned: 0 in 0.500s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7044ec13-41a9-4149-868d-5c6bce556280 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:27 devstack sudo[92701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7044ec13-41a9-4149-868d-5c6bce556280 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6
Sep 16 08:39:27 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:27 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7044ec13-41a9-4149-868d-5c6bce556280 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6" returned: 0 in 0.346s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:27 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:39:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:27 devstack sudo[92707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6
Sep 16 08:39:27 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:27 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6" returned: 0 in 0.299s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:27 devstack sudo[92711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.info
Sep 16 08:39:27 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:27 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.info" returned: 0 in 0.285s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:27 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:39:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:27 devstack sudo[92714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.info
Sep 16 08:39:27 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:28 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.info" returned: 0 in 0.253s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Acquiring lock "cinder-quobyte-c3b66248-20fa-4525-9b09-ca37da07991b" by "_copy_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Lock "cinder-quobyte-c3b66248-20fa-4525-9b09-ca37da07991b" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] snapshot: 3807f9f2-0cb5-46d1-96a4-97e726adf5a6, volume: c3b66248-20fa-4525-9b09-ca37da07991b,  {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[517273a8-6469-4b5b-8d31-2c18bae3b453]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:28 devstack sudo[92717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6
Sep 16 08:39:28 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:28 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6" returned: 0 in 0.419s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7044ec13-41a9-4149-868d-5c6bce556280(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eed81c-bdbd-44df-9454-6152a1b9b58d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:39:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:28 devstack sudo[92722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280
Sep 16 08:39:28 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:29 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280" returned: 0 in 0.414s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 08:39:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Creating direct copy from snapshot {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 08:39:29 devstack cinder-volume[86261]: DEBUG cinder.utils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Path /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b not found in is_blk_device check {{(pid=86261) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 08:39:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:29 devstack sudo[92728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b
Sep 16 08:39:29 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Acquiring lock "cinder-4930c6f0-3337-45dc-b011-d3126cfc59ef-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:39:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Lock "cinder-4930c6f0-3337-45dc-b011-d3126cfc59ef-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:39:34 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=99,cinder:INSERT=27,cinder:UPDATE=72,cinder:DELETE=4 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:39:34 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=102,cinder:DELETE=11,cinder:SELECT=85,cinder:INSERT=10 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:39:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Acquiring lock "cinder-quobyte-4930c6f0-3337-45dc-b011-d3126cfc59ef" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:39:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Lock "cinder-quobyte-4930c6f0-3337-45dc-b011-d3126cfc59ef" acquired by "delete_volume" :: waited 0.056s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:39:35 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf84828-702d-4136-923a-67fea2fff4e1]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:39:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4930c6f0-3337-45dc-b011-d3126cfc59ef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:35 devstack sudo[92754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4930c6f0-3337-45dc-b011-d3126cfc59ef
Sep 16 08:39:35 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:36 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4930c6f0-3337-45dc-b011-d3126cfc59ef" returned: 0 in 1.239s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4930c6f0-3337-45dc-b011-d3126cfc59ef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:36 devstack sudo[92795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4930c6f0-3337-45dc-b011-d3126cfc59ef
Sep 16 08:39:36 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:37 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4930c6f0-3337-45dc-b011-d3126cfc59ef" returned: 0 in 0.723s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Lock "cinder-quobyte-4930c6f0-3337-45dc-b011-d3126cfc59ef" released by "delete_volume" :: held 2.136s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:39:37 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Created reservations ['2827e99e-57b1-4d11-9bfc-2fb266262f4b', 'cd8b057f-ee78-4969-80d7-00f4ba44fb51', '8f550388-3592-4722-acfc-9c319e729e08', 'd0143a4d-c99e-4caa-b6c6-be3352307bc5'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:39:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:39:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:39:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:39:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:39:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:39:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:37 devstack sudo[92825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:39:37 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:37 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.390s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:37 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:39:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Deleted volume successfully.
Sep 16 08:39:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-31dd7e03-9dcc-4772-911f-e677243745c8 tempest-VolumesNegativeTest-1398455808 None] Lock "cinder-4930c6f0-3337-45dc-b011-d3126cfc59ef-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:39:39 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b" returned: 0 in 10.480s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:39 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280, size 1024.00 MB, duration 10.48 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:39:39 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Converted 1024.00 MB image at 97.69 MB/s
Sep 16 08:39:39 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:39:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:39 devstack sudo[92843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b
Sep 16 08:39:39 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b" returned: 0 in 0.359s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:39 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Lock "cinder-quobyte-c3b66248-20fa-4525-9b09-ca37da07991b" released by "_copy_volume_from_snapshot" :: held 11.776s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:39:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Acquiring lock "cinder-quobyte-3807f9f2-0cb5-46d1-96a4-97e726adf5a6" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:39:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Lock "cinder-quobyte-3807f9f2-0cb5-46d1-96a4-97e726adf5a6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:39:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Deleting offline snapshot 3807f9f2-0cb5-46d1-96a4-97e726adf5a6 of volume 7044ec13-41a9-4149-868d-5c6bce556280 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:39:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] snapshot_file for this snap is: volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:39:40 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd34e23-1d08-4ff2-a6f5-17bcdfea71ae]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:39:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:40 devstack sudo[92873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6
Sep 16 08:39:40 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:40 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6" returned: 0 in 0.502s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7044ec13-41a9-4149-868d-5c6bce556280(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:39:40 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbd1d4b-8cac-40c0-9349-97b92802fe71]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:39:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:40 devstack sudo[92896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280
Sep 16 08:39:40 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:41 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280" returned: 0 in 0.809s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:41 devstack sudo[92904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6
Sep 16 08:39:41 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:42 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6" returned: 0 in 0.496s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:42 devstack sudo[92911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6
Sep 16 08:39:42 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:42 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280.3807f9f2-0cb5-46d1-96a4-97e726adf5a6" returned: 0 in 0.300s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Lock "cinder-quobyte-3807f9f2-0cb5-46d1-96a4-97e726adf5a6" released by "_delete_snapshot" :: held 2.300s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:39:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.566s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:39:42 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a91bf0de-9cfc-44bc-919c-e52d7e3ee99a tempest-GroupsV314Test-860050458 None] Create group from source-group-a156d622-9909-411d-8948-92a1708538ad completed successfully.
Sep 16 08:39:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Acquiring lock "cinder-quobyte-c3b66248-20fa-4525-9b09-ca37da07991b" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:39:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Lock "cinder-quobyte-c3b66248-20fa-4525-9b09-ca37da07991b" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:39:43 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[791b3fef-7358-4b21-a8c0-7f71488557f5]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:39:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:44 devstack sudo[92914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b
Sep 16 08:39:44 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:44 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b" returned: 0 in 0.456s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:44 devstack sudo[92920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b
Sep 16 08:39:44 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:44 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c3b66248-20fa-4525-9b09-ca37da07991b" returned: 0 in 0.338s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Lock "cinder-quobyte-c3b66248-20fa-4525-9b09-ca37da07991b" released by "delete_volume" :: held 0.861s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:39:44 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Created reservations ['9e8a53c6-3400-48e3-9698-8dac90bd2edf'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:39:44 devstack cinder-volume[86261]: WARNING cinder.quota [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1897337455 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1897337455, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:39:44 devstack cinder-volume[86261]: WARNING cinder.quota [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1897337455 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1897337455, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:39:44 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Created reservations ['0f52bdf4-b477-48a1-8161-00f38d54b532', 'ca08f0bb-d1a4-4762-830e-f7c6cee8f071', 'b59fbd74-2e4b-41a8-a0dc-003f60302415', 'cc91ff2c-23f9-4022-a2dc-83868769f0e6'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:39:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:39:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:39:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:39:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:39:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:39:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:45 devstack sudo[92923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:39:45 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:45 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.374s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:45 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:39:45 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b67b5767-6199-47e3-8beb-b0bb1d3494b2 tempest-GroupsV314Test-860050458 None] Delete group completed successfully.
Sep 16 08:39:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Acquiring lock "cinder-quobyte-7044ec13-41a9-4149-868d-5c6bce556280" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:39:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Lock "cinder-quobyte-7044ec13-41a9-4149-868d-5c6bce556280" acquired by "delete_volume" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:39:45 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf63a1c-4614-4711-b8b5-671a70d17f65]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:39:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:45 devstack sudo[92927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280
Sep 16 08:39:45 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:46 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-afad637e-af79-4499-968c-a4c12c40f234 req-4594efc1-0694-4b35-9cca-1531250caa0e tempest-AttachVolumeNegativeTest-2009469181 None] Terminate volume connection completed successfully.
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-afad637e-af79-4499-968c-a4c12c40f234 req-4594efc1-0694-4b35-9cca-1531250caa0e tempest-AttachVolumeNegativeTest-2009469181 None] Deleting attachment 18827c97-4112-451b-85e0-86007d00947d. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:39:46 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280" returned: 0 in 0.583s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:46 devstack sudo[92935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280
Sep 16 08:39:46 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:46 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7044ec13-41a9-4149-868d-5c6bce556280" returned: 0 in 0.320s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Lock "cinder-quobyte-7044ec13-41a9-4149-868d-5c6bce556280" released by "delete_volume" :: held 0.996s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Created reservations ['e1c2debb-cfe9-4609-8c76-ee03c761f590'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Created reservations ['17414cd0-5c4f-4189-b047-b1d8b945f425', '04441213-2d41-41f6-9d63-561a28b71c7b', '556758ec-3521-4668-8986-99faf2b13c21', 'ffc22af8-93a2-4566-bc76-4aab76774b16'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:39:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:47 devstack sudo[92939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:39:47 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:39:47 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root
Sep 16 08:39:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.420s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:39:47 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:39:47 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-799a614e-35af-4ce7-89c7-43531132f0a5 tempest-GroupsV314Test-860050458 None] Delete group completed successfully.
Sep 16 08:39:49 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-24cf67ae-41f5-4fa9-b010-4d367d3e74d6 req-2c2e3c28-c204-4207-a346-bd2642d6e086 tempest-ServerActionsTestOtherA-1577147641 None] Terminate volume connection completed successfully.
Sep 16 08:39:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-24cf67ae-41f5-4fa9-b010-4d367d3e74d6 req-2c2e3c28-c204-4207-a346-bd2642d6e086 tempest-ServerActionsTestOtherA-1577147641 None] Deleting attachment a5c0e9f5-d109-4f8a-9044-17f6cdaabea0. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:39:58 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:39:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Flow 'volume_create_manager' (0dc0a54d-e69c-4090-b221-3643d2976d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:39:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617ebda7-0deb-480f-a73f-917ddc1b177b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617ebda7-0deb-480f-a73f-917ddc1b177b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1838701712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cd167e-9c31-4366-91eb-025a36556e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4047803a140449e8dc3ccd8ba50edd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:39:59Z,use_quota=True,user_id='dd4761e024244422a517b0d013ab9983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b83536c-d00d-48f4-a039-61449dd81baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b83536c-d00d-48f4-a039-61449dd81baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e20fabf-85b1-4541-a820-07da1266016f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:58 devstack cinder-volume[86261]: DEBUG cinder.image.glance [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Creating Keystone auth plugin from conf {{(pid=86261) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 08:39:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e20fabf-85b1-4541-a820-07da1266016f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6cd167e-9c31-4366-91eb-025a36556e2c', 'volume_name': 'volume-a6cd167e-9c31-4366-91eb-025a36556e2c', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef2122d0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45510d37-cba6-4bf3-acbb-1243012f6bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45510d37-cba6-4bf3-acbb-1243012f6bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:39:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3f6b13-b58f-4844-8b3d-84e45505b224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:39:59 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Volume a6cd167e-9c31-4366-91eb-025a36556e2c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6cd167e-9c31-4366-91eb-025a36556e2c', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef2122d0>}
Sep 16 08:39:59 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Trying to clone a6cd167e-9c31-4366-91eb-025a36556e2c from image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]). {{(pid=86261) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 08:39:59 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 08:39:59 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 08:39:59 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f8dced-6fbd-4ba3-9a2b-c235b2e9b7d8]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:39:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:39:59 devstack sudo[93008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD
Sep 16 08:39:59 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:00 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Temporary image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 is fetched for user dd4761e024244422a517b0d013ab9983. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f57076-5c04-4286-b165-19879561d3a9]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:00 devstack sudo[93016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD
Sep 16 08:40:00 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:00 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1838701712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cd167e-9c31-4366-91eb-025a36556e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4047803a140449e8dc3ccd8ba50edd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:39:59Z,use_quota=True,user_id='dd4761e024244422a517b0d013ab9983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Creating volume a6cd167e-9c31-4366-91eb-025a36556e2c {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:40:00 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:40:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:00 devstack sudo[93021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c 1073741824
Sep 16 08:40:00 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:01 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c 1073741824" returned: 0 in 0.732s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:01 devstack sudo[93029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c
Sep 16 08:40:01 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:01 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c" returned: 0 in 0.312s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:40:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:01 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Attempting download of 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}])) to volume a6cd167e-9c31-4366-91eb-025a36556e2c. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 08:40:01 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[678981c5-2cb9-4464-b362-98eb6c02e823]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:40:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7___1s48j4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:02 devstack sudo[93032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7___1s48j4
Sep 16 08:40:02 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:02 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7___1s48j4" returned: 0 in 0.392s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7___1s48j4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:02 devstack sudo[93037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7___1s48j4
Sep 16 08:40:02 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:02 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7___1s48j4" returned: 1 in 0.589s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7___1s48j4' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:40:02 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1f41e6-d05e-4c14-a527-9f6144d8a2b6]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:40:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:03 devstack sudo[93052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD
Sep 16 08:40:03 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:03 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:03 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 was qcow2, converting to qcow2 {{(pid=86261) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 08:40:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:03 devstack sudo[93064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c
Sep 16 08:40:03 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:06 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c" returned: 0 in 2.522s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_e1xj4m8idevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:40:06 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Converted 112.00 MB image at 44.39 MB/s
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:06 devstack sudo[93074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c 1G
Sep 16 08:40:06 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:06 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c 1G" returned: 0 in 0.423s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Downloaded image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}])) to volume a6cd167e-9c31-4366-91eb-025a36556e2c successfully. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Temporary image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 for user dd4761e024244422a517b0d013ab9983 is deleted. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Marking volume a6cd167e-9c31-4366-91eb-025a36556e2c as bootable. {{(pid=86261) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Copying metadata from image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 to a6cd167e-9c31-4366-91eb-025a36556e2c. {{(pid=86261) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Creating volume glance metadata for volume a6cd167e-9c31-4366-91eb-025a36556e2c backed by image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86261) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3f6b13-b58f-4844-8b3d-84e45505b224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6cd167e-9c31-4366-91eb-025a36556e2c', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef2122d0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d72090-8888-4c5c-9d5f-ec31f5a6c4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:06 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Volume volume-a6cd167e-9c31-4366-91eb-025a36556e2c (a6cd167e-9c31-4366-91eb-025a36556e2c): created successfully
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d72090-8888-4c5c-9d5f-ec31f5a6c4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Flow 'volume_create_manager' (0dc0a54d-e69c-4090-b221-3643d2976d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:06 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c8a86c83-2534-4eb5-9e10-124543f1555a tempest-ServerActionsTestOtherA-1577147641 None] Created volume successfully.
Sep 16 08:40:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:40:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:40:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:40:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:12 devstack sudo[93154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:40:12 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:13 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.630s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:40:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:40:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:40:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:40:15 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:40:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Flow 'volume_create_manager' (3288d1f6-3111-407c-af10-c6447d37b880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ca8aa5-a27f-4674-8605-4f5514ea1acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ca8aa5-a27f-4674-8605-4f5514ea1acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-727973045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a6cd2994484ac0b1b94ae188b28122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:16Z,use_quota=True,user_id='5f73b4bb3e5a41a79e0c5d39ffc8ce7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5656d74-84bd-443e-97c6-789dd7eb659c),volume_type_id=d5656d74-84bd-443e-97c6-789dd7eb659c)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0d6a5c-16f5-4e55-acde-9d40c7996edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0d6a5c-16f5-4e55-acde-9d40c7996edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef147fc0-d489-48f9-8f8a-62bd0c775310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef147fc0-d489-48f9-8f8a-62bd0c775310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999', 'volume_name': 'volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3630ce-4800-49a1-b470-369d38bcd9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3630ce-4800-49a1-b470-369d38bcd9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f20889d-e2ec-4319-8b4b-03e44c000c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:16 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Volume 4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999', 'volume_size': 1}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-727973045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a6cd2994484ac0b1b94ae188b28122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:16Z,use_quota=True,user_id='5f73b4bb3e5a41a79e0c5d39ffc8ce7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5656d74-84bd-443e-97c6-789dd7eb659c),volume_type_id=d5656d74-84bd-443e-97c6-789dd7eb659c)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Creating volume 4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:40:16 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:16 devstack sudo[93160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999 1073741824
Sep 16 08:40:16 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Flow 'volume_create_manager' (04b9fab0-1519-4dca-8875-6663f75943bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f012f53-58b1-48f3-b251-12bf5bc61150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f012f53-58b1-48f3-b251-12bf5bc61150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-719194554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9a29ce-c2cf-4b11-b986-9fae40c3edf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a6cd2994484ac0b1b94ae188b28122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:17Z,use_quota=True,user_id='5f73b4bb3e5a41a79e0c5d39ffc8ce7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec2287c8-a42d-4016-be76-1befabedbc01),volume_type_id=ec2287c8-a42d-4016-be76-1befabedbc01)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6267068-3445-4afd-b9ac-133294a980aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6267068-3445-4afd-b9ac-133294a980aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb226be-f1c1-486b-af3d-0678dcb3e462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb226be-f1c1-486b-af3d-0678dcb3e462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af9a29ce-c2cf-4b11-b986-9fae40c3edf0', 'volume_name': 'volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d471d9d-bd3f-4a83-8c33-588e9b3fb849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d471d9d-bd3f-4a83-8c33-588e9b3fb849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bf885f-2192-47a4-b17f-132a2c045991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:16 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Volume af9a29ce-c2cf-4b11-b986-9fae40c3edf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0', 'volume_size': 1}
Sep 16 08:40:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:17 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999 1073741824" returned: 0 in 1.105s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:17 devstack sudo[93174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999
Sep 16 08:40:17 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-024eb223-421b-40cc-846e-a37af515aa8b req-9340d599-dcd2-4e3e-b6f1-394375ab6845 tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:17 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999" returned: 0 in 0.415s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.780s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-719194554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9a29ce-c2cf-4b11-b986-9fae40c3edf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a6cd2994484ac0b1b94ae188b28122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:17Z,use_quota=True,user_id='5f73b4bb3e5a41a79e0c5d39ffc8ce7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec2287c8-a42d-4016-be76-1befabedbc01),volume_type_id=ec2287c8-a42d-4016-be76-1befabedbc01)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Creating volume af9a29ce-c2cf-4b11-b986-9fae40c3edf0 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:40:17 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f20889d-e2ec-4319-8b4b-03e44c000c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:17 devstack sudo[93177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0 1073741824
Sep 16 08:40:17 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95850d0b-519b-45db-a9b5-a5e17827f648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:17 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Volume volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999 (4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999): created successfully
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95850d0b-519b-45db-a9b5-a5e17827f648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Flow 'volume_create_manager' (3288d1f6-3111-407c-af10-c6447d37b880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:17 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4cd9bf1b-0616-4363-871b-01aaaa09e80c tempest-TestInstancesWithCinderVolumes-684334313 None] Created volume successfully.
Sep 16 08:40:18 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:40:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Flow 'volume_create_manager' (0b139d4d-02b2-42a6-9cb4-a41ceb7f36a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6171e06-2b6f-48d5-8a02-a9a77c01a0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6171e06-2b6f-48d5-8a02-a9a77c01a0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-289988573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb03d87-84d7-4ab4-977d-28e42be88ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a6cd2994484ac0b1b94ae188b28122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:18Z,use_quota=True,user_id='5f73b4bb3e5a41a79e0c5d39ffc8ce7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40dd845a-8c4d-4a40-af17-82896489ecfd),volume_type_id=40dd845a-8c4d-4a40-af17-82896489ecfd)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae25a6b4-39da-4900-b8d0-e693966e89c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae25a6b4-39da-4900-b8d0-e693966e89c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adf37d1-cc05-41df-9bde-74b61b3bde5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:18 devstack cinder-volume[86261]: DEBUG cinder.image.glance [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Creating Keystone auth plugin from conf {{(pid=86261) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 08:40:18 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0 1073741824" returned: 0 in 0.954s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:18 devstack sudo[93183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0
Sep 16 08:40:18 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adf37d1-cc05-41df-9bde-74b61b3bde5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cfb03d87-84d7-4ab4-977d-28e42be88ff2', 'volume_name': 'volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2', 'volume_size': 1, 'image_id': '3e1c9136-31ed-45fb-9937-56c1b45410e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e1c9136-31ed-45fb-9937-56c1b45410e9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1404029341', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a6cd2994484ac0b1b94ae188b28122', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e1c9136-31ed-45fb-9937-56c1b45410e9', 'created_at': datetime.datetime(2026, 9, 16, 6, 40, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e1c9136-31ed-45fb-9937-56c1b45410e9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef3251f0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ec0e34-360c-4b9e-863e-38cbae7bd11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ec0e34-360c-4b9e-863e-38cbae7bd11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce3715c-bd74-4118-bc8e-ca2d094b6fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:19 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Volume cfb03d87-84d7-4ab4-977d-28e42be88ff2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2', 'volume_size': 1, 'image_id': '3e1c9136-31ed-45fb-9937-56c1b45410e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e1c9136-31ed-45fb-9937-56c1b45410e9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1404029341', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a6cd2994484ac0b1b94ae188b28122', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e1c9136-31ed-45fb-9937-56c1b45410e9', 'created_at': datetime.datetime(2026, 9, 16, 6, 40, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e1c9136-31ed-45fb-9937-56c1b45410e9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef3251f0>}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Trying to clone cfb03d87-84d7-4ab4-977d-28e42be88ff2 from image 3e1c9136-31ed-45fb-9937-56c1b45410e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e1c9136-31ed-45fb-9937-56c1b45410e9', 'metadata': {}}]). {{(pid=86261) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 08:40:19 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0" returned: 0 in 0.590s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-024eb223-421b-40cc-846e-a37af515aa8b req-9340d599-dcd2-4e3e-b6f1-394375ab6845 tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.004s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bf885f-2192-47a4-b17f-132a2c045991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347c9dcb-f955-4ef5-8c4d-0903b8589abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-024eb223-421b-40cc-846e-a37af515aa8b req-9340d599-dcd2-4e3e-b6f1-394375ab6845 tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:19 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Volume volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0 (af9a29ce-c2cf-4b11-b986-9fae40c3edf0): created successfully
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347c9dcb-f955-4ef5-8c4d-0903b8589abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Flow 'volume_create_manager' (04b9fab0-1519-4dca-8875-6663f75943bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:19 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-855423bd-2949-411e-96c0-73f5d23de724 tempest-TestInstancesWithCinderVolumes-684334313 None] Created volume successfully.
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-024eb223-421b-40cc-846e-a37af515aa8b req-9340d599-dcd2-4e3e-b6f1-394375ab6845 tempest-ServerActionsTestOtherA-1577147641 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-a6cd167e-9c31-4366-91eb-025a36556e2c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf00de53-8c84-48ab-b423-11a74850119d', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Flow 'volume_create_manager' (f3da36c1-b9a0-48c9-ab2a-d960ad95a2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c222c69d-18bb-4003-9f45-539e03bff7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c222c69d-18bb-4003-9f45-539e03bff7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-24594034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388a492a-ef71-47eb-a60a-e6eae306c875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57dfaac6e1104b5d9238374a723e16f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:19Z,use_quota=True,user_id='76dfface32824a008278527f516856f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9352f124-1c1e-401c-a9b3-13c4a2d4a60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9352f124-1c1e-401c-a9b3-13c4a2d4a60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b3c58a-15ff-457c-8266-a6567724e331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b3c58a-15ff-457c-8266-a6567724e331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '388a492a-ef71-47eb-a60a-e6eae306c875', 'volume_name': 'volume-388a492a-ef71-47eb-a60a-e6eae306c875', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1ef802-71ad-4ae1-8215-c205536e50bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1ef802-71ad-4ae1-8215-c205536e50bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b04e443-1cd9-46f3-bee4-fb0eba5b8c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:19 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Volume 388a492a-ef71-47eb-a60a-e6eae306c875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-388a492a-ef71-47eb-a60a-e6eae306c875', 'volume_size': 1}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-24594034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388a492a-ef71-47eb-a60a-e6eae306c875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57dfaac6e1104b5d9238374a723e16f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:19Z,use_quota=True,user_id='76dfface32824a008278527f516856f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Creating volume 388a492a-ef71-47eb-a60a-e6eae306c875 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:40:19 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:40:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-388a492a-ef71-47eb-a60a-e6eae306c875 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:19 devstack sudo[93186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-388a492a-ef71-47eb-a60a-e6eae306c875 1073741824
Sep 16 08:40:19 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:19 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-024eb223-421b-40cc-846e-a37af515aa8b req-9340d599-dcd2-4e3e-b6f1-394375ab6845 tempest-ServerActionsTestOtherA-1577147641 None] attachment_update completed successfully.
Sep 16 08:40:20 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-388a492a-ef71-47eb-a60a-e6eae306c875 1073741824" returned: 0 in 0.820s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-388a492a-ef71-47eb-a60a-e6eae306c875 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:20 devstack sudo[93193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-388a492a-ef71-47eb-a60a-e6eae306c875
Sep 16 08:40:20 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:21 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-388a492a-ef71-47eb-a60a-e6eae306c875" returned: 0 in 0.436s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:40:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b04e443-1cd9-46f3-bee4-fb0eba5b8c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-388a492a-ef71-47eb-a60a-e6eae306c875', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c388a31-07b1-448f-89ce-e2e9ee6cf8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:21 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Volume volume-388a492a-ef71-47eb-a60a-e6eae306c875 (388a492a-ef71-47eb-a60a-e6eae306c875): created successfully
Sep 16 08:40:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c388a31-07b1-448f-89ce-e2e9ee6cf8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Flow 'volume_create_manager' (f3da36c1-b9a0-48c9-ab2a-d960ad95a2a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:21 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d8d6a21b-cc66-4722-8abe-cf06ec0d7d9f tempest-VolumeQuotasAdminTestJSON-1074835875 None] Created volume successfully.
Sep 16 08:40:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Acquiring lock "cinder-388a492a-ef71-47eb-a60a-e6eae306c875-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:40:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "cinder-388a492a-ef71-47eb-a60a-e6eae306c875-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:40:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Acquiring lock "cinder-quobyte-388a492a-ef71-47eb-a60a-e6eae306c875" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:40:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "cinder-quobyte-388a492a-ef71-47eb-a60a-e6eae306c875" acquired by "delete_volume" :: waited 0.042s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:40:22 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[521ca557-1e8b-4c5f-a6ca-b85df25c4cd8]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:40:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-388a492a-ef71-47eb-a60a-e6eae306c875 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:22 devstack sudo[93638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-388a492a-ef71-47eb-a60a-e6eae306c875
Sep 16 08:40:22 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:22 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-388a492a-ef71-47eb-a60a-e6eae306c875" returned: 0 in 0.607s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-388a492a-ef71-47eb-a60a-e6eae306c875 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:22 devstack sudo[93651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-388a492a-ef71-47eb-a60a-e6eae306c875
Sep 16 08:40:22 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:23 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-388a492a-ef71-47eb-a60a-e6eae306c875" returned: 0 in 0.338s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "cinder-quobyte-388a492a-ef71-47eb-a60a-e6eae306c875" released by "delete_volume" :: held 1.012s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:40:23 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Created reservations ['8f17fde2-2923-40d8-b666-46e094f133e1', '52197c28-daed-4aea-a27e-30bfd758e805', '2b426ebe-858d-4f69-b9b8-3af883e91b99', 'ad238cb1-2b07-410b-b6fd-ea49d901bd3e'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:40:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:40:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:40:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:23 devstack sudo[93654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:40:23 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:24 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.586s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:24 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:40:24 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Deleted volume successfully.
Sep 16 08:40:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9756059d-87bc-4895-a48b-57a3d34f1def tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "cinder-388a492a-ef71-47eb-a60a-e6eae306c875-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Flow 'volume_create_manager' (a4d892fb-4db4-45eb-9c6c-2c9499b4401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53de62b-8469-4bc6-bc0b-eb68d4e305ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53de62b-8469-4bc6-bc0b-eb68d4e305ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1025679528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf8f40f-73e4-456c-9dd7-ea3d10539fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57dfaac6e1104b5d9238374a723e16f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:25Z,use_quota=True,user_id='76dfface32824a008278527f516856f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c07ad6-de78-4f3a-abcd-72e5de9860b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c07ad6-de78-4f3a-abcd-72e5de9860b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e19ded-7715-422e-9f28-fed2f800ba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e19ded-7715-422e-9f28-fed2f800ba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf8f40f-73e4-456c-9dd7-ea3d10539fba', 'volume_name': 'volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747a0f69-bf52-4298-85da-d5e393c1d12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747a0f69-bf52-4298-85da-d5e393c1d12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47b948b-6fd7-40e7-a042-0817c596c4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:25 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Volume faf8f40f-73e4-456c-9dd7-ea3d10539fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba', 'volume_size': 1}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1025679528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf8f40f-73e4-456c-9dd7-ea3d10539fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57dfaac6e1104b5d9238374a723e16f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:25Z,use_quota=True,user_id='76dfface32824a008278527f516856f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Creating volume faf8f40f-73e4-456c-9dd7-ea3d10539fba {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:40:25 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:25 devstack sudo[93659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba 1073741824
Sep 16 08:40:25 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD, size 20.69 MB, duration 6.13 sec {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 08:40:25 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Image download 20.69 MB at 3.37 MB/s
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b6dbde-90d4-4d8f-9c06-4734290c8ef5]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:40:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:25 devstack sudo[93661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD
Sep 16 08:40:25 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:26 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD" returned: 0 in 0.539s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Temporary image 3e1c9136-31ed-45fb-9937-56c1b45410e9 is fetched for user 5f73b4bb3e5a41a79e0c5d39ffc8ce7a. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 08:40:26 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba 1073741824" returned: 0 in 0.833s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a7ba1e-2e1b-4e10-a28c-16f370a8764c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:26 devstack sudo[93688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba
Sep 16 08:40:26 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:26 devstack sudo[93687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD
Sep 16 08:40:26 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:26 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba" returned: 0 in 0.291s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47b948b-6fd7-40e7-a042-0817c596c4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23e80d1-727d-4c52-a7e3-82411ccb5554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:26 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Volume volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba (faf8f40f-73e4-456c-9dd7-ea3d10539fba): created successfully
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23e80d1-727d-4c52-a7e3-82411ccb5554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Flow 'volume_create_manager' (a4d892fb-4db4-45eb-9c6c-2c9499b4401a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:26 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-557eec7e-4470-4faf-8462-c2c527b6a710 tempest-VolumeQuotasAdminTestJSON-1074835875 None] Created volume successfully.
Sep 16 08:40:26 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD" returned: 0 in 0.590s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-289988573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb03d87-84d7-4ab4-977d-28e42be88ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a6cd2994484ac0b1b94ae188b28122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:18Z,use_quota=True,user_id='5f73b4bb3e5a41a79e0c5d39ffc8ce7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40dd845a-8c4d-4a40-af17-82896489ecfd),volume_type_id=40dd845a-8c4d-4a40-af17-82896489ecfd)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Creating volume cfb03d87-84d7-4ab4-977d-28e42be88ff2 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:40:26 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:40:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:26 devstack sudo[93696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2 1073741824
Sep 16 08:40:26 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:27 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2 1073741824" returned: 0 in 0.693s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:27 devstack sudo[93704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2
Sep 16 08:40:27 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:28 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2" returned: 0 in 0.502s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:40:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:28 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Attempting download of 3e1c9136-31ed-45fb-9937-56c1b45410e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e1c9136-31ed-45fb-9937-56c1b45410e9', 'metadata': {}}])) to volume cfb03d87-84d7-4ab4-977d-28e42be88ff2. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 08:40:28 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[866a384c-7d86-4ae0-b8f8-c19bb2821401]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:40:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e1c9136-31ed-45fb-9937-56c1b45410e9_k_x9yms_ {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:28 devstack sudo[93708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e1c9136-31ed-45fb-9937-56c1b45410e9_k_x9yms_
Sep 16 08:40:28 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:28 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7c71ca71-6962-4d8f-86e5-89d4682efa90 tempest-VolumeQuotasAdminTestJSON-1881689047 None] Transfer volume completed successfully.
Sep 16 08:40:28 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e1c9136-31ed-45fb-9937-56c1b45410e9_k_x9yms_" returned: 0 in 0.521s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e1c9136-31ed-45fb-9937-56c1b45410e9_k_x9yms_ {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:28 devstack sudo[93712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e1c9136-31ed-45fb-9937-56c1b45410e9_k_x9yms_
Sep 16 08:40:28 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:29 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e1c9136-31ed-45fb-9937-56c1b45410e9_k_x9yms_" returned: 1 in 0.368s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e1c9136-31ed-45fb-9937-56c1b45410e9_k_x9yms_' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6d089b-e654-445a-ba02-11dd09112ed8]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:29 devstack sudo[93716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD
Sep 16 08:40:29 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Acquiring lock "cinder-faf8f40f-73e4-456c-9dd7-ea3d10539fba-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Lock "cinder-faf8f40f-73e4-456c-9dd7-ea3d10539fba-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Acquiring lock "cinder-quobyte-faf8f40f-73e4-456c-9dd7-ea3d10539fba" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Lock "cinder-quobyte-faf8f40f-73e4-456c-9dd7-ea3d10539fba" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3725fb-2432-413b-8d81-1d2c6d7964ab]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:29 devstack sudo[93719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba
Sep 16 08:40:29 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:29 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] 3e1c9136-31ed-45fb-9937-56c1b45410e9 was qcow2, converting to qcow2 {{(pid=86261) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 08:40:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:30 devstack sudo[93725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2
Sep 16 08:40:30 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:30 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba" returned: 0 in 0.651s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:30 devstack sudo[93734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba
Sep 16 08:40:30 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:30 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-faf8f40f-73e4-456c-9dd7-ea3d10539fba" returned: 0 in 0.391s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Lock "cinder-quobyte-faf8f40f-73e4-456c-9dd7-ea3d10539fba" released by "delete_volume" :: held 1.139s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:40:30 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Created reservations ['f6f02e63-4002-46c8-8b9d-df68f31d049d', '3cfc62db-7bf4-4fd4-b79f-5eb6aece841a', '91f5666b-6188-4eff-8f48-464870c44144', 'f464d9f6-47fe-4233-9428-0b6b8378639a'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:40:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:40:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:40:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:31 devstack sudo[93741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:40:31 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:31 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.404s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:31 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:40:31 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Deleted volume successfully.
Sep 16 08:40:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f947e09c-1cf4-46b6-ab35-1b452553b962 tempest-VolumeQuotasAdminTestJSON-139655 None] Lock "cinder-faf8f40f-73e4-456c-9dd7-ea3d10539fba-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:40:32 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2" returned: 0 in 2.769s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:32 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e1c9136-31ed-45fb-9937-56c1b45410e9_oqrdha5tdevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:40:32 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Converted 112.00 MB image at 40.40 MB/s
Sep 16 08:40:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:32 devstack sudo[93747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2 1G
Sep 16 08:40:32 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:33 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2 1G" returned: 0 in 0.476s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:33 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Downloaded image 3e1c9136-31ed-45fb-9937-56c1b45410e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e1c9136-31ed-45fb-9937-56c1b45410e9', 'metadata': {}}])) to volume cfb03d87-84d7-4ab4-977d-28e42be88ff2 successfully. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 08:40:33 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Temporary image 3e1c9136-31ed-45fb-9937-56c1b45410e9 for user 5f73b4bb3e5a41a79e0c5d39ffc8ce7a is deleted. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 08:40:33 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Marking volume cfb03d87-84d7-4ab4-977d-28e42be88ff2 as bootable. {{(pid=86261) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 08:40:33 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Copying metadata from image 3e1c9136-31ed-45fb-9937-56c1b45410e9 to cfb03d87-84d7-4ab4-977d-28e42be88ff2. {{(pid=86261) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 08:40:33 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Creating volume glance metadata for volume cfb03d87-84d7-4ab4-977d-28e42be88ff2 backed by image 3e1c9136-31ed-45fb-9937-56c1b45410e9 with: {'image_id': '3e1c9136-31ed-45fb-9937-56c1b45410e9', 'image_name': 'tempest-scenario-img--1404029341', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86261) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 08:40:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce3715c-bd74-4118-bc8e-ca2d094b6fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2', 'volume_size': 1, 'image_id': '3e1c9136-31ed-45fb-9937-56c1b45410e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e1c9136-31ed-45fb-9937-56c1b45410e9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1404029341', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b8a6cd2994484ac0b1b94ae188b28122', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3e1c9136-31ed-45fb-9937-56c1b45410e9', 'created_at': datetime.datetime(2026, 9, 16, 6, 40, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 40, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e1c9136-31ed-45fb-9937-56c1b45410e9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef3251f0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6548e72c-9015-4b4f-93ac-fa1886773d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:33 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Volume volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2 (cfb03d87-84d7-4ab4-977d-28e42be88ff2): created successfully
Sep 16 08:40:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6548e72c-9015-4b4f-93ac-fa1886773d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Flow 'volume_create_manager' (0b139d4d-02b2-42a6-9cb4-a41ceb7f36a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:33 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-732d72c9-164f-4c27-b976-065a09991c4b tempest-TestInstancesWithCinderVolumes-684334313 None] Created volume successfully.
Sep 16 08:40:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-3e1126d0-cf62-4ed6-9770-2dbf8ff1209b req-37eeb542-b212-490a-963a-26cc333a7775 tempest-ServerActionsTestOtherA-1577147641 None] Terminate volume connection completed successfully.
Sep 16 08:40:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3e1126d0-cf62-4ed6-9770-2dbf8ff1209b req-37eeb542-b212-490a-963a-26cc333a7775 tempest-ServerActionsTestOtherA-1577147641 None] Deleting attachment bf00de53-8c84-48ab-b423-11a74850119d. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:40:36 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=72,cinder:UPDATE=69,cinder:DELETE=4,cinder:INSERT=24 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:40:36 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=66,cinder:INSERT=26,cinder:UPDATE=73,cinder:DELETE=5 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:40:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-3e1126d0-cf62-4ed6-9770-2dbf8ff1209b req-03aa8800-55f8-407b-a83d-fc2e41cb19a5 tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-3e1126d0-cf62-4ed6-9770-2dbf8ff1209b req-03aa8800-55f8-407b-a83d-fc2e41cb19a5 tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-3e1126d0-cf62-4ed6-9770-2dbf8ff1209b req-03aa8800-55f8-407b-a83d-fc2e41cb19a5 tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-3e1126d0-cf62-4ed6-9770-2dbf8ff1209b req-03aa8800-55f8-407b-a83d-fc2e41cb19a5 tempest-ServerActionsTestOtherA-1577147641 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-a6cd167e-9c31-4366-91eb-025a36556e2c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ecfd32ff-13e3-4fc5-bb69-470585cd92ba', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:40:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-3e1126d0-cf62-4ed6-9770-2dbf8ff1209b req-03aa8800-55f8-407b-a83d-fc2e41cb19a5 tempest-ServerActionsTestOtherA-1577147641 None] attachment_update completed successfully.
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Flow 'volume_create_manager' (0459f58b-29ae-4fa2-9db7-ba05f4f900eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69736c9-0818-40c7-ab31-a4bbb0ef9197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69736c9-0818-40c7-ab31-a4bbb0ef9197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1883719124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db189254-a49a-49b1-825f-e008a76970b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72d2a7e1cac40db8fd520d924406b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:37Z,use_quota=True,user_id='9a6b2551947e49e480c7ebb2449af26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9af7725-36aa-40aa-8f76-9038a892899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9af7725-36aa-40aa-8f76-9038a892899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6f27d2-b904-4b04-a049-0f60ba72eeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6f27d2-b904-4b04-a049-0f60ba72eeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db189254-a49a-49b1-825f-e008a76970b4', 'volume_name': 'volume-db189254-a49a-49b1-825f-e008a76970b4', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7037193b-ccba-4ceb-b82b-15c6e141ef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7037193b-ccba-4ceb-b82b-15c6e141ef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b8fe53-dd3a-41ec-bf07-9b32acb96779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:37 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Volume db189254-a49a-49b1-825f-e008a76970b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db189254-a49a-49b1-825f-e008a76970b4', 'volume_size': 1}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1883719124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db189254-a49a-49b1-825f-e008a76970b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72d2a7e1cac40db8fd520d924406b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:37Z,use_quota=True,user_id='9a6b2551947e49e480c7ebb2449af26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Creating volume db189254-a49a-49b1-825f-e008a76970b4 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:40:37 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:40:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db189254-a49a-49b1-825f-e008a76970b4 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:37 devstack sudo[93851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db189254-a49a-49b1-825f-e008a76970b4 1073741824
Sep 16 08:40:37 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:38 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db189254-a49a-49b1-825f-e008a76970b4 1073741824" returned: 0 in 0.959s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db189254-a49a-49b1-825f-e008a76970b4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:38 devstack sudo[94295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db189254-a49a-49b1-825f-e008a76970b4
Sep 16 08:40:38 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:39 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db189254-a49a-49b1-825f-e008a76970b4" returned: 0 in 0.481s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:40:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b8fe53-dd3a-41ec-bf07-9b32acb96779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db189254-a49a-49b1-825f-e008a76970b4', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6df924-ff57-4cb5-9f57-0e7bc834552b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:39 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Volume volume-db189254-a49a-49b1-825f-e008a76970b4 (db189254-a49a-49b1-825f-e008a76970b4): created successfully
Sep 16 08:40:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6df924-ff57-4cb5-9f57-0e7bc834552b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Flow 'volume_create_manager' (0459f58b-29ae-4fa2-9db7-ba05f4f900eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-142f5c21-5afc-493b-8b6c-b0de44277678 req-d0710d74-e197-45f6-91a5-d637b0730430 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-142f5c21-5afc-493b-8b6c-b0de44277678 req-d0710d74-e197-45f6-91a5-d637b0730430 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:39 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-eff942b9-e267-4084-8861-4d72d945899a tempest-AttachVolumeNegativeTest-2009469181 None] Created volume successfully.
Sep 16 08:40:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-142f5c21-5afc-493b-8b6c-b0de44277678 req-d0710d74-e197-45f6-91a5-d637b0730430 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-142f5c21-5afc-493b-8b6c-b0de44277678 req-d0710d74-e197-45f6-91a5-d637b0730430 tempest-TestInstancesWithCinderVolumes-684334313 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20eb566d-37bf-4eff-95c0-0bd0084a96a0', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:40:39 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-142f5c21-5afc-493b-8b6c-b0de44277678 req-d0710d74-e197-45f6-91a5-d637b0730430 tempest-TestInstancesWithCinderVolumes-684334313 None] attachment_update completed successfully.
Sep 16 08:40:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-749f41c8-f2ba-4a0c-96e7-c170cae8bd28 req-941eb525-73f3-411b-afe8-10be9aad3447 tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-749f41c8-f2ba-4a0c-96e7-c170cae8bd28 req-941eb525-73f3-411b-afe8-10be9aad3447 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-749f41c8-f2ba-4a0c-96e7-c170cae8bd28 req-941eb525-73f3-411b-afe8-10be9aad3447 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-749f41c8-f2ba-4a0c-96e7-c170cae8bd28 req-941eb525-73f3-411b-afe8-10be9aad3447 tempest-AttachVolumeNegativeTest-2009469181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-db189254-a49a-49b1-825f-e008a76970b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aec9cba2-a993-42fb-ac81-1310f639521d', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:40:42 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-749f41c8-f2ba-4a0c-96e7-c170cae8bd28 req-941eb525-73f3-411b-afe8-10be9aad3447 tempest-AttachVolumeNegativeTest-2009469181 None] attachment_update completed successfully.
Sep 16 08:40:46 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-134142b0-9ebb-4c14-b1ed-a7d465c1895a req-07960a26-1b52-4d8d-8b0d-a915db2f47c3 tempest-AttachVolumeNegativeTest-2009469181 None] Terminate volume connection completed successfully.
Sep 16 08:40:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-134142b0-9ebb-4c14-b1ed-a7d465c1895a req-07960a26-1b52-4d8d-8b0d-a915db2f47c3 tempest-AttachVolumeNegativeTest-2009469181 None] Deleting attachment aec9cba2-a993-42fb-ac81-1310f639521d. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Flow 'volume_create_manager' (4726b0d0-0d3e-4796-aaad-fa43245ebc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302a4dbc-8a47-4899-b013-2aae61fc714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302a4dbc-8a47-4899-b013-2aae61fc714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-740533009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509f2d6b-8f7d-4738-9af3-8988d05b648b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55ea7fd6f7f409e93194dff65382d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:48Z,use_quota=True,user_id='fce8edb9719b4f0eb228c99cfef3070a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5de9ca5-6999-4117-b081-bef3f43e660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5de9ca5-6999-4117-b081-bef3f43e660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858a091d-cb50-431b-9da1-b360d831f2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858a091d-cb50-431b-9da1-b360d831f2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509f2d6b-8f7d-4738-9af3-8988d05b648b', 'volume_name': 'volume-509f2d6b-8f7d-4738-9af3-8988d05b648b', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8ab5e8-e1ea-444d-bb69-8322cdf0de63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8ab5e8-e1ea-444d-bb69-8322cdf0de63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930d3abd-9597-4335-83bc-a7ef3142b816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:48 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Volume 509f2d6b-8f7d-4738-9af3-8988d05b648b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509f2d6b-8f7d-4738-9af3-8988d05b648b', 'volume_size': 1}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-740533009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509f2d6b-8f7d-4738-9af3-8988d05b648b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55ea7fd6f7f409e93194dff65382d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:40:48Z,use_quota=True,user_id='fce8edb9719b4f0eb228c99cfef3070a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Creating volume 509f2d6b-8f7d-4738-9af3-8988d05b648b {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:40:48 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:40:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-509f2d6b-8f7d-4738-9af3-8988d05b648b 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:48 devstack sudo[94438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-509f2d6b-8f7d-4738-9af3-8988d05b648b 1073741824
Sep 16 08:40:48 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:49 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-509f2d6b-8f7d-4738-9af3-8988d05b648b 1073741824" returned: 0 in 1.158s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-509f2d6b-8f7d-4738-9af3-8988d05b648b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:49 devstack sudo[94456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-509f2d6b-8f7d-4738-9af3-8988d05b648b
Sep 16 08:40:49 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:50 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-509f2d6b-8f7d-4738-9af3-8988d05b648b" returned: 0 in 0.513s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:40:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930d3abd-9597-4335-83bc-a7ef3142b816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509f2d6b-8f7d-4738-9af3-8988d05b648b', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7c8d23-3942-4df4-a975-03cfde300bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:40:50 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Volume volume-509f2d6b-8f7d-4738-9af3-8988d05b648b (509f2d6b-8f7d-4738-9af3-8988d05b648b): created successfully
Sep 16 08:40:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7c8d23-3942-4df4-a975-03cfde300bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:40:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Flow 'volume_create_manager' (4726b0d0-0d3e-4796-aaad-fa43245ebc8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:40:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-390839c7-5a99-4c36-ae3a-c2badccd7a7e tempest-VolumeQuotasNegativeTestJSON-742075921 None] Created volume successfully.
Sep 16 08:40:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Acquiring lock "cinder-509f2d6b-8f7d-4738-9af3-8988d05b648b-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:40:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Lock "cinder-509f2d6b-8f7d-4738-9af3-8988d05b648b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:40:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Acquiring lock "cinder-quobyte-509f2d6b-8f7d-4738-9af3-8988d05b648b" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:40:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Lock "cinder-quobyte-509f2d6b-8f7d-4738-9af3-8988d05b648b" acquired by "delete_volume" :: waited 0.046s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:40:53 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc93ef5b-fafd-4e28-b5e2-ccb8ac1fb486]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:40:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-509f2d6b-8f7d-4738-9af3-8988d05b648b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:53 devstack sudo[94469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-509f2d6b-8f7d-4738-9af3-8988d05b648b
Sep 16 08:40:53 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:54 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-509f2d6b-8f7d-4738-9af3-8988d05b648b" returned: 0 in 0.590s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-509f2d6b-8f7d-4738-9af3-8988d05b648b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:54 devstack sudo[94474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-509f2d6b-8f7d-4738-9af3-8988d05b648b
Sep 16 08:40:54 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:54 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-509f2d6b-8f7d-4738-9af3-8988d05b648b" returned: 0 in 0.556s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Lock "cinder-quobyte-509f2d6b-8f7d-4738-9af3-8988d05b648b" released by "delete_volume" :: held 1.240s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:40:54 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Created reservations ['cfc77b4b-5987-41c0-b88f-95be0cf1616e', 'bf386ad5-8e27-4801-898e-3afaec42cfa4', '1da1279a-03c7-4d74-a23a-45c18dc7e8f2', '0769e1b8-9614-46e7-a714-088a145048cf'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:40:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:40:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:40:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:40:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:40:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:40:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:40:55 devstack sudo[94477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:40:55 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:40:55 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root
Sep 16 08:40:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.882s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:40:55 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:40:55 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Deleted volume successfully.
Sep 16 08:40:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-618ee75f-b37e-41c5-91fb-5912bd2e7cdd tempest-VolumeQuotasNegativeTestJSON-742075921 None] Lock "cinder-509f2d6b-8f7d-4738-9af3-8988d05b648b-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:04 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=26,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:41:05 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=31,cinder:UPDATE=21,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:41:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:41:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:12 devstack sudo[94627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:41:12 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:12 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.336s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:41:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:41:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:41:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:41:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-241a0740-3938-4db7-8599-a798c0637e64 req-7c9a5cf6-310d-4af8-812e-5deba8ebb86e tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-241a0740-3938-4db7-8599-a798c0637e64 req-7c9a5cf6-310d-4af8-812e-5deba8ebb86e tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-241a0740-3938-4db7-8599-a798c0637e64 req-7c9a5cf6-310d-4af8-812e-5deba8ebb86e tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-241a0740-3938-4db7-8599-a798c0637e64 req-7c9a5cf6-310d-4af8-812e-5deba8ebb86e tempest-TestInstancesWithCinderVolumes-684334313 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a454f8f5-d476-473d-a595-fb52b03d14f6', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:41:18 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-241a0740-3938-4db7-8599-a798c0637e64 req-7c9a5cf6-310d-4af8-812e-5deba8ebb86e tempest-TestInstancesWithCinderVolumes-684334313 None] attachment_update completed successfully.
Sep 16 08:41:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-5007ff90-5d12-4567-be04-b3ff99fba8b3 req-c821ea7b-3db7-47f2-b3e0-d5249e7922d9 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-5007ff90-5d12-4567-be04-b3ff99fba8b3 req-c821ea7b-3db7-47f2-b3e0-d5249e7922d9 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-5007ff90-5d12-4567-be04-b3ff99fba8b3 req-c821ea7b-3db7-47f2-b3e0-d5249e7922d9 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-5007ff90-5d12-4567-be04-b3ff99fba8b3 req-c821ea7b-3db7-47f2-b3e0-d5249e7922d9 tempest-TestInstancesWithCinderVolumes-684334313 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed911ea2-e5a0-466e-93eb-9e311024998d', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:41:20 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-5007ff90-5d12-4567-be04-b3ff99fba8b3 req-c821ea7b-3db7-47f2-b3e0-d5249e7922d9 tempest-TestInstancesWithCinderVolumes-684334313 None] attachment_update completed successfully.
Sep 16 08:41:25 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-7fde7f22-fa30-4a47-9a34-04abb568b6e7 tempest-ServerActionsTestOtherA-1577147641 None] Terminate volume connection completed successfully.
Sep 16 08:41:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-7fde7f22-fa30-4a47-9a34-04abb568b6e7 tempest-ServerActionsTestOtherA-1577147641 None] Deleting attachment ecfd32ff-13e3-4fc5-bb69-470585cd92ba. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:41:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "cinder-a6cd167e-9c31-4366-91eb-025a36556e2c-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Lock "cinder-a6cd167e-9c31-4366-91eb-025a36556e2c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "cinder-quobyte-a6cd167e-9c31-4366-91eb-025a36556e2c" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Lock "cinder-quobyte-a6cd167e-9c31-4366-91eb-025a36556e2c" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:26 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[593c3e34-0809-4e3e-a477-5f74585c1574]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:41:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:26 devstack sudo[94739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c
Sep 16 08:41:26 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:26 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c" returned: 0 in 0.511s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:26 devstack sudo[94749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c
Sep 16 08:41:26 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:27 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a6cd167e-9c31-4366-91eb-025a36556e2c" returned: 0 in 0.291s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Lock "cinder-quobyte-a6cd167e-9c31-4366-91eb-025a36556e2c" released by "delete_volume" :: held 0.864s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG cinder.quota [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Created reservations ['241d7c93-484c-40d9-b016-f89617969745', 'b80a6bdf-17e6-40b6-93db-224bf2bfe4ca', '89b8de8c-10ee-4ff5-b184-96dd8f2b0b14', 'ccd426ba-c314-49de-aad1-c8ea8a6e7deb'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:27 devstack sudo[94754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:41:27 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-0bd2abab-5d0d-40ee-8893-ca23d9ab79a3 req-427f8aea-7189-451b-b74d-a680c6a5df56 tempest-TestInstancesWithCinderVolumes-684334313 None] Terminate volume connection completed successfully.
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-0bd2abab-5d0d-40ee-8893-ca23d9ab79a3 req-427f8aea-7189-451b-b74d-a680c6a5df56 tempest-TestInstancesWithCinderVolumes-684334313 None] Deleting attachment a454f8f5-d476-473d-a595-fb52b03d14f6. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:41:27 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.291s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG cinder.manager [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:41:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Deleted volume successfully.
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-c0e80603-4862-4d7b-8e87-76b93a45b2a5 req-a9482ebb-bb90-4942-8b8f-ec37b05d9dfd tempest-ServerActionsTestOtherA-1577147641 None] Lock "cinder-a6cd167e-9c31-4366-91eb-025a36556e2c-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "cinder-867fa8ab-d855-4f29-8a8f-0eeb037555a9-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Lock "cinder-867fa8ab-d855-4f29-8a8f-0eeb037555a9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "cinder-quobyte-867fa8ab-d855-4f29-8a8f-0eeb037555a9" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Lock "cinder-quobyte-867fa8ab-d855-4f29-8a8f-0eeb037555a9" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[efccba69-6e25-4a00-9cbd-15db6eedc1ef]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:41:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "cinder-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "cinder-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:28 devstack sudo[94757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9
Sep 16 08:41:28 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "cinder-quobyte-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "cinder-quobyte-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c67954-45c2-4161-9a07-19001bc960ca]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:28 devstack sudo[94763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999
Sep 16 08:41:28 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:28 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9" returned: 0 in 0.419s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:28 devstack sudo[94768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9
Sep 16 08:41:28 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:28 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-867fa8ab-d855-4f29-8a8f-0eeb037555a9" returned: 0 in 0.270s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Lock "cinder-quobyte-867fa8ab-d855-4f29-8a8f-0eeb037555a9" released by "delete_volume" :: held 0.768s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:28 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999" returned: 0 in 0.526s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:28 devstack sudo[94774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999
Sep 16 08:41:28 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Created reservations ['9d790724-5466-418e-b5f6-2751aacf5406', '96d45b01-9977-4711-9fd7-043b17cd4e46', '74ea48b3-d121-4fbb-a451-aeb0e7723455', '56ff6055-6fec-4a0e-a849-e314bf516318'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:28 devstack sudo[94776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:41:28 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:29 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999" returned: 0 in 0.444s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "cinder-quobyte-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999" released by "delete_volume" :: held 1.040s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:29 devstack cinder-volume[86261]: WARNING cinder.quota [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-958746952-398366480 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-958746952-398366480, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:41:29 devstack cinder-volume[86261]: WARNING cinder.quota [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-958746952-398366480 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-958746952-398366480, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:41:29 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Created reservations ['5f71abae-420b-434a-92e9-e2a5392200b4', '0ba5e463-90ca-40fd-959d-dab67cd554bf', '2035a5b8-b533-42ba-94d1-fe54a70d4b9f', '081caf5f-3f82-4526-b5cf-7aaf5a011397'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:41:29 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.486s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:29 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:41:29 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Deleted volume successfully.
Sep 16 08:41:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eee2b499-2d64-4d0d-80c3-e7ac07b63503 tempest-ServerActionsTestOtherA-1577147641 None] Lock "cinder-867fa8ab-d855-4f29-8a8f-0eeb037555a9-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:29 devstack sudo[94782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:41:29 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:30 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.702s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:30 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:41:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Deleted volume successfully.
Sep 16 08:41:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e6a534b9-3b0b-4fea-b510-4376105c9fb3 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "cinder-4e7de1f5-785b-4b59-a1c1-c7f9d4d4f999-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Flow 'volume_create_manager' (244aee64-a4b6-41f3-b026-7bdde0e5d32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534f7d25-76d2-40ad-87ef-c08754d9867e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534f7d25-76d2-40ad-87ef-c08754d9867e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1145995355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78801a1-93fc-444c-b4cc-0671687d6b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17642cf0fc9444597a6a2d48c4875fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:41:31Z,use_quota=True,user_id='349d4b49586e4777add38680bf34eca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b641b4d3-f589-43ee-a29a-3515124fc2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b641b4d3-f589-43ee-a29a-3515124fc2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffd8a68-7ba4-4c76-8d2d-d92c8df17bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffd8a68-7ba4-4c76-8d2d-d92c8df17bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f78801a1-93fc-444c-b4cc-0671687d6b55', 'volume_name': 'volume-f78801a1-93fc-444c-b4cc-0671687d6b55', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5ca4ad-6d77-4ba5-be04-df8b95a3d47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5ca4ad-6d77-4ba5-be04-df8b95a3d47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe63b5bf-59f0-45ae-89cf-d922aa83a8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:31 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Volume f78801a1-93fc-444c-b4cc-0671687d6b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f78801a1-93fc-444c-b4cc-0671687d6b55', 'volume_size': 1}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1145995355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78801a1-93fc-444c-b4cc-0671687d6b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17642cf0fc9444597a6a2d48c4875fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:41:31Z,use_quota=True,user_id='349d4b49586e4777add38680bf34eca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Creating volume f78801a1-93fc-444c-b4cc-0671687d6b55 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:41:31 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:41:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f78801a1-93fc-444c-b4cc-0671687d6b55 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:31 devstack sudo[94814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f78801a1-93fc-444c-b4cc-0671687d6b55 1073741824
Sep 16 08:41:31 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:32 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f78801a1-93fc-444c-b4cc-0671687d6b55 1073741824" returned: 0 in 0.480s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f78801a1-93fc-444c-b4cc-0671687d6b55 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:32 devstack sudo[94830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f78801a1-93fc-444c-b4cc-0671687d6b55
Sep 16 08:41:32 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:32 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f78801a1-93fc-444c-b4cc-0671687d6b55" returned: 0 in 0.264s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:41:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe63b5bf-59f0-45ae-89cf-d922aa83a8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78801a1-93fc-444c-b4cc-0671687d6b55', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a4ec77-e97b-48da-9b6f-a00e340de89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:32 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Volume volume-f78801a1-93fc-444c-b4cc-0671687d6b55 (f78801a1-93fc-444c-b4cc-0671687d6b55): created successfully
Sep 16 08:41:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a4ec77-e97b-48da-9b6f-a00e340de89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Flow 'volume_create_manager' (244aee64-a4b6-41f3-b026-7bdde0e5d32d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:41:32 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9bc4115a-acbb-455f-85ed-e7b561edc980 tempest-VolumesMetadataTest-383912275 None] Created volume successfully.
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Flow 'volume_create_manager' (121dc8b6-27e5-4365-838e-2e4cff6c7373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad6f167-27a1-4de6-9614-b54be84c3c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad6f167-27a1-4de6-9614-b54be84c3c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1492963162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db508f6-d280-443c-952e-31a0d0529d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72d2a7e1cac40db8fd520d924406b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:41:33Z,use_quota=True,user_id='9a6b2551947e49e480c7ebb2449af26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fba1f44-3b85-4f97-82b4-d9a3ca75e993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fba1f44-3b85-4f97-82b4-d9a3ca75e993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ad6f45-f26d-4d33-97f0-1936ed024896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ad6f45-f26d-4d33-97f0-1936ed024896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db508f6-d280-443c-952e-31a0d0529d32', 'volume_name': 'volume-0db508f6-d280-443c-952e-31a0d0529d32', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92acd1f3-ff16-41d1-b938-7856cea13bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92acd1f3-ff16-41d1-b938-7856cea13bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf8b8d9-dd7b-4f60-8174-e9a31e5b61dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:33 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Volume 0db508f6-d280-443c-952e-31a0d0529d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db508f6-d280-443c-952e-31a0d0529d32', 'volume_size': 1}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1492963162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db508f6-d280-443c-952e-31a0d0529d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72d2a7e1cac40db8fd520d924406b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:41:33Z,use_quota=True,user_id='9a6b2551947e49e480c7ebb2449af26f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Creating volume 0db508f6-d280-443c-952e-31a0d0529d32 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:41:33 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0db508f6-d280-443c-952e-31a0d0529d32 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:33 devstack sudo[94841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0db508f6-d280-443c-952e-31a0d0529d32 1073741824
Sep 16 08:41:33 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:33 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-d7e23b23-637d-4f28-894d-dbc41e3d9947 req-6a755a6a-d068-4438-bc9a-77ef02ae842d tempest-TestInstancesWithCinderVolumes-684334313 None] Terminate volume connection completed successfully.
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-d7e23b23-637d-4f28-894d-dbc41e3d9947 req-6a755a6a-d068-4438-bc9a-77ef02ae842d tempest-TestInstancesWithCinderVolumes-684334313 None] Deleting attachment ed911ea2-e5a0-466e-93eb-9e311024998d. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:41:33 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0db508f6-d280-443c-952e-31a0d0529d32 1073741824" returned: 0 in 0.520s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0db508f6-d280-443c-952e-31a0d0529d32 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:33 devstack sudo[94846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0db508f6-d280-443c-952e-31a0d0529d32
Sep 16 08:41:33 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "cinder-af9a29ce-c2cf-4b11-b986-9fae40c3edf0-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "cinder-af9a29ce-c2cf-4b11-b986-9fae40c3edf0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "cinder-quobyte-af9a29ce-c2cf-4b11-b986-9fae40c3edf0" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "cinder-quobyte-af9a29ce-c2cf-4b11-b986-9fae40c3edf0" acquired by "delete_volume" :: waited 0.030s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b228d254-43d8-4ec9-960e-d99df1a17a4c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:34 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0db508f6-d280-443c-952e-31a0d0529d32" returned: 0 in 0.382s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf8b8d9-dd7b-4f60-8174-e9a31e5b61dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db508f6-d280-443c-952e-31a0d0529d32', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ba131b-68e1-4896-8dba-6661be9da5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:34 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Volume volume-0db508f6-d280-443c-952e-31a0d0529d32 (0db508f6-d280-443c-952e-31a0d0529d32): created successfully
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ba131b-68e1-4896-8dba-6661be9da5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Flow 'volume_create_manager' (121dc8b6-27e5-4365-838e-2e4cff6c7373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:41:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9ddea2de-841d-466a-afc4-9cce87a60e50 tempest-AttachVolumeNegativeTest-2009469181 None] Created volume successfully.
Sep 16 08:41:34 devstack sudo[94849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0
Sep 16 08:41:34 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Acquiring lock "cinder-f78801a1-93fc-444c-b4cc-0671687d6b55-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Lock "cinder-f78801a1-93fc-444c-b4cc-0671687d6b55-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Acquiring lock "cinder-quobyte-f78801a1-93fc-444c-b4cc-0671687d6b55" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Lock "cinder-quobyte-f78801a1-93fc-444c-b4cc-0671687d6b55" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:34 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0" returned: 0 in 0.534s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6936c606-f9aa-4a58-a370-75def4b9370f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f78801a1-93fc-444c-b4cc-0671687d6b55 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:34 devstack sudo[94854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0
Sep 16 08:41:34 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:34 devstack sudo[94855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f78801a1-93fc-444c-b4cc-0671687d6b55
Sep 16 08:41:34 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:34 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-af9a29ce-c2cf-4b11-b986-9fae40c3edf0" returned: 0 in 0.285s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "cinder-quobyte-af9a29ce-c2cf-4b11-b986-9fae40c3edf0" released by "delete_volume" :: held 0.904s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:34 devstack cinder-volume[86261]: WARNING cinder.quota [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-881879164-306416509 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-881879164-306416509, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:41:34 devstack cinder-volume[86261]: WARNING cinder.quota [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-881879164-306416509 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-881879164-306416509, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Created reservations ['f23d2713-e86f-4e77-86fe-1e4a1fcdc749', '633e82b5-2ebe-4320-8d9e-5696ea65e5ef', 'f8e9dd72-3c78-472e-a925-8526cba3980c', '323449a9-a8bf-4c44-a9b1-d6bc55957144'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:41:35 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f78801a1-93fc-444c-b4cc-0671687d6b55" returned: 0 in 0.433s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f78801a1-93fc-444c-b4cc-0671687d6b55 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:35 devstack sudo[94863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f78801a1-93fc-444c-b4cc-0671687d6b55
Sep 16 08:41:35 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:35 devstack sudo[94865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:41:35 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:35 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f78801a1-93fc-444c-b4cc-0671687d6b55" returned: 0 in 0.387s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Lock "cinder-quobyte-f78801a1-93fc-444c-b4cc-0671687d6b55" released by "delete_volume" :: held 0.916s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Created reservations ['ac18e957-7287-42f2-8ab6-7df06c029770', '556e13b2-fd5a-4b10-9584-6d19245856d3', '9e8a6c9b-9fed-40a1-a997-0a581c435f5d', '3bbc1433-4bbf-44a5-80af-c335f00d0a4e'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:41:35 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.525s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:35 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Deleted volume successfully.
Sep 16 08:41:35 devstack sudo[94873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:41:35 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d17fa1b3-bf7b-41ca-820d-9f0c8e990e22 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "cinder-af9a29ce-c2cf-4b11-b986-9fae40c3edf0-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:36 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.369s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:36 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:41:36 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Deleted volume successfully.
Sep 16 08:41:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d342816a-3be3-4dfe-b3b9-3f265db33eb6 tempest-VolumesMetadataTest-383912275 None] Lock "cinder-f78801a1-93fc-444c-b4cc-0671687d6b55-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-6c61f056-f1d0-4680-84b8-03f066fa4a8e req-34af2c4d-8b26-428f-b1fa-cae24615066d tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-6c61f056-f1d0-4680-84b8-03f066fa4a8e req-34af2c4d-8b26-428f-b1fa-cae24615066d tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-6c61f056-f1d0-4680-84b8-03f066fa4a8e req-34af2c4d-8b26-428f-b1fa-cae24615066d tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-6c61f056-f1d0-4680-84b8-03f066fa4a8e req-34af2c4d-8b26-428f-b1fa-cae24615066d tempest-AttachVolumeNegativeTest-2009469181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-0db508f6-d280-443c-952e-31a0d0529d32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cadf6345-83ac-4378-b50e-e18a69102cb4', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:41:36 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-6c61f056-f1d0-4680-84b8-03f066fa4a8e req-34af2c4d-8b26-428f-b1fa-cae24615066d tempest-AttachVolumeNegativeTest-2009469181 None] attachment_update completed successfully.
Sep 16 08:41:39 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-90c92730-d14b-4415-99a2-d2583941fe0a req-cdc8a4f6-7123-4bf2-a67e-28c243c03699 tempest-AttachVolumeNegativeTest-2009469181 None] Terminate volume connection completed successfully.
Sep 16 08:41:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-90c92730-d14b-4415-99a2-d2583941fe0a req-cdc8a4f6-7123-4bf2-a67e-28c243c03699 tempest-AttachVolumeNegativeTest-2009469181 None] Deleting attachment cadf6345-83ac-4378-b50e-e18a69102cb4. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:41:40 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-361b301a-fc5e-4ac9-8480-0bc888fe4317 req-84cac1f6-43ea-48f5-8c6b-4a9148248c65 tempest-TestInstancesWithCinderVolumes-684334313 None] Terminate volume connection completed successfully.
Sep 16 08:41:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-361b301a-fc5e-4ac9-8480-0bc888fe4317 req-84cac1f6-43ea-48f5-8c6b-4a9148248c65 tempest-TestInstancesWithCinderVolumes-684334313 None] Deleting attachment 20eb566d-37bf-4eff-95c0-0bd0084a96a0. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:41:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "cinder-cfb03d87-84d7-4ab4-977d-28e42be88ff2-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "cinder-cfb03d87-84d7-4ab4-977d-28e42be88ff2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "cinder-quobyte-cfb03d87-84d7-4ab4-977d-28e42be88ff2" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "cinder-quobyte-cfb03d87-84d7-4ab4-977d-28e42be88ff2" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:41 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e1067e-cfb0-4149-ad60-3060a217df8d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:41:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:41 devstack sudo[94976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2
Sep 16 08:41:41 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:42 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2" returned: 0 in 0.683s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:42 devstack sudo[94981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2
Sep 16 08:41:42 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:42 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cfb03d87-84d7-4ab4-977d-28e42be88ff2" returned: 0 in 0.410s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "cinder-quobyte-cfb03d87-84d7-4ab4-977d-28e42be88ff2" released by "delete_volume" :: held 1.172s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:42 devstack cinder-volume[86261]: WARNING cinder.quota [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1599237817-2110582066 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1599237817-2110582066, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:41:42 devstack cinder-volume[86261]: WARNING cinder.quota [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1599237817-2110582066 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1599237817-2110582066, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:41:42 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Created reservations ['d49a98f7-15f9-4595-9f93-1ab6ce1cdf51', 'b15ee0fd-77ec-4a64-8ea0-ca7603ecfe8f', 'bd8947f6-741c-44ad-8a3f-02b36ad5f8ca', 'ffad4993-8d0e-4a02-8ee7-1b593ac0a4ae'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:41:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:42 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:42 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:42 devstack sudo[94987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:41:42 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:43 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.300s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:43 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:41:43 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Deleted volume successfully.
Sep 16 08:41:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a1e0a17e-3bfb-4306-8678-e1952d97b118 tempest-TestInstancesWithCinderVolumes-684334313 None] Lock "cinder-cfb03d87-84d7-4ab4-977d-28e42be88ff2-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "cinder-0db508f6-d280-443c-952e-31a0d0529d32-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "cinder-0db508f6-d280-443c-952e-31a0d0529d32-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "cinder-quobyte-0db508f6-d280-443c-952e-31a0d0529d32" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "cinder-quobyte-0db508f6-d280-443c-952e-31a0d0529d32" acquired by "delete_volume" :: waited 0.037s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:45 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bf8f56-2f3b-4570-be47-b6c9e22b35f1]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:41:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0db508f6-d280-443c-952e-31a0d0529d32 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:45 devstack sudo[94990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0db508f6-d280-443c-952e-31a0d0529d32
Sep 16 08:41:45 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:45 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0db508f6-d280-443c-952e-31a0d0529d32" returned: 0 in 0.548s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0db508f6-d280-443c-952e-31a0d0529d32 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:45 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:41:45 devstack sudo[94995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0db508f6-d280-443c-952e-31a0d0529d32
Sep 16 08:41:45 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Flow 'volume_create_manager' (7d4e760b-223f-45ff-b510-dbd09051bf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:41:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fcbe67-b647-4d7f-81c8-1f1bbd41fe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fcbe67-b647-4d7f-81c8-1f1bbd41fe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1002365357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50b19c4-5922-4fde-b797-1baa8ec47ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7ddc07a8ce4ab6b872d4ddff450839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:41:46Z,use_quota=True,user_id='fdede095c7554819a0334435d501b132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36176e71-620e-42ac-9e93-fb3e2db35540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36176e71-620e-42ac-9e93-fb3e2db35540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de475770-e336-4090-aa4a-4470a81d0b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de475770-e336-4090-aa4a-4470a81d0b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50b19c4-5922-4fde-b797-1baa8ec47ae3', 'volume_name': 'volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51c7740-f29e-4fc0-b9e5-664b9462745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51c7740-f29e-4fc0-b9e5-664b9462745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160de09e-63d5-42b5-94d1-59bfb9f1003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:46 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Volume b50b19c4-5922-4fde-b797-1baa8ec47ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3', 'volume_size': 1}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1002365357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50b19c4-5922-4fde-b797-1baa8ec47ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7ddc07a8ce4ab6b872d4ddff450839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:41:46Z,use_quota=True,user_id='fdede095c7554819a0334435d501b132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Creating volume b50b19c4-5922-4fde-b797-1baa8ec47ae3 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:41:46 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:46 devstack sudo[94997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3 1073741824
Sep 16 08:41:46 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:46 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0db508f6-d280-443c-952e-31a0d0529d32" returned: 0 in 0.303s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "cinder-quobyte-0db508f6-d280-443c-952e-31a0d0529d32" released by "delete_volume" :: held 0.920s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Created reservations ['533684f1-21cf-44af-9ad2-b5a5c8007446', 'abc90ee7-6a13-4c09-b432-7d7dc741f287', 'bddc365f-0011-40fb-8110-681f8722876b', 'cdde86e8-7c9a-40d5-893c-9cf47e5f72cb'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:46 devstack sudo[95003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:41:46 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:46 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3 1073741824" returned: 0 in 0.611s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:46 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.314s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:41:46 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Deleted volume successfully.
Sep 16 08:41:46 devstack sudo[95007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3
Sep 16 08:41:46 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a80ecd2b-7b1a-4e58-92e6-31043ca6ffa1 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "cinder-0db508f6-d280-443c-952e-31a0d0529d32-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:47 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3" returned: 0 in 0.286s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160de09e-63d5-42b5-94d1-59bfb9f1003b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d5daa7-1653-4e23-867e-702ef6ef3093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:47 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Volume volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3 (b50b19c4-5922-4fde-b797-1baa8ec47ae3): created successfully
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d5daa7-1653-4e23-867e-702ef6ef3093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Flow 'volume_create_manager' (7d4e760b-223f-45ff-b510-dbd09051bf71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:41:47 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-79c31b36-fcac-4456-8204-37876dc573f4 tempest-VolumesTransfersTest-1268695506 None] Created volume successfully.
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "cinder-db189254-a49a-49b1-825f-e008a76970b4-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "cinder-db189254-a49a-49b1-825f-e008a76970b4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "cinder-quobyte-db189254-a49a-49b1-825f-e008a76970b4" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "cinder-quobyte-db189254-a49a-49b1-825f-e008a76970b4" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[838ff22f-d876-4ddb-bd36-c7f3f56b7818]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:41:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db189254-a49a-49b1-825f-e008a76970b4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:47 devstack sudo[95011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db189254-a49a-49b1-825f-e008a76970b4
Sep 16 08:41:47 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:48 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db189254-a49a-49b1-825f-e008a76970b4" returned: 0 in 0.524s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db189254-a49a-49b1-825f-e008a76970b4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:48 devstack sudo[95016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db189254-a49a-49b1-825f-e008a76970b4
Sep 16 08:41:48 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:48 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db189254-a49a-49b1-825f-e008a76970b4" returned: 0 in 0.364s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "cinder-quobyte-db189254-a49a-49b1-825f-e008a76970b4" released by "delete_volume" :: held 0.939s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:48 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Created reservations ['61bd6d0e-c83a-466b-9a1b-eb1c7daf9106', '14bceb90-6dec-4d46-9d53-71a1eefbd07a', 'b9797351-e46b-41d8-86d2-4664c402bff1', '343c73ed-4970-437b-9467-a6cb550c2fb5'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:41:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:48 devstack sudo[95019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:41:48 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:48 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8c6a4d2a-c45c-4ed2-a1dc-a9f5418dbb92 tempest-VolumesTransfersTest-1437666725 None] Transfer volume completed successfully.
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "cinder-532ee01c-8510-4374-bbc6-82052c0a5fd8-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:49 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.356s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:41:49 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Deleted volume successfully.
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Lock "cinder-532ee01c-8510-4374-bbc6-82052c0a5fd8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-03e1325e-ac1d-4c58-9776-b2338059d343 tempest-AttachVolumeNegativeTest-2009469181 None] Lock "cinder-db189254-a49a-49b1-825f-e008a76970b4-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "cinder-quobyte-532ee01c-8510-4374-bbc6-82052c0a5fd8" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Lock "cinder-quobyte-532ee01c-8510-4374-bbc6-82052c0a5fd8" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10de032-0d5f-43dc-bc65-c98e598bc3ab]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-532ee01c-8510-4374-bbc6-82052c0a5fd8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:49 devstack sudo[95022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-532ee01c-8510-4374-bbc6-82052c0a5fd8
Sep 16 08:41:49 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Acquiring lock "cinder-b50b19c4-5922-4fde-b797-1baa8ec47ae3-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Lock "cinder-b50b19c4-5922-4fde-b797-1baa8ec47ae3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:49 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-532ee01c-8510-4374-bbc6-82052c0a5fd8" returned: 0 in 0.636s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-532ee01c-8510-4374-bbc6-82052c0a5fd8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:49 devstack sudo[95028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-532ee01c-8510-4374-bbc6-82052c0a5fd8
Sep 16 08:41:49 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Acquiring lock "cinder-quobyte-b50b19c4-5922-4fde-b797-1baa8ec47ae3" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Lock "cinder-quobyte-b50b19c4-5922-4fde-b797-1baa8ec47ae3" acquired by "delete_volume" :: waited 0.035s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4397a46a-76f3-445e-8769-c46d459e0ca0]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:50 devstack sudo[95030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3
Sep 16 08:41:50 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:50 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-532ee01c-8510-4374-bbc6-82052c0a5fd8" returned: 0 in 0.446s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Lock "cinder-quobyte-532ee01c-8510-4374-bbc6-82052c0a5fd8" released by "delete_volume" :: held 1.154s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Created reservations ['dabd238a-7d9b-4f49-b6d0-57f94804b8a6', 'dddfca54-0564-4e42-ac5b-1b51581df87f', 'afb634b3-5d08-4e1d-9e37-1a72dd48faf7', '1d36cb09-c47b-46e8-9455-93b9e50dbd96'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:50 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3" returned: 0 in 0.513s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:50 devstack sudo[95037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:41:50 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:50 devstack sudo[95038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3
Sep 16 08:41:50 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:50 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.332s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:41:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Deleted volume successfully.
Sep 16 08:41:50 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b50b19c4-5922-4fde-b797-1baa8ec47ae3" returned: 0 in 0.338s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e8ab3f5a-ba4b-4669-a38e-49c1082bb54f tempest-AttachVolumeNegativeTest-2009469181 None] Lock "cinder-532ee01c-8510-4374-bbc6-82052c0a5fd8-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Lock "cinder-quobyte-b50b19c4-5922-4fde-b797-1baa8ec47ae3" released by "delete_volume" :: held 0.912s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:51 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Created reservations ['e5fd786c-3060-45f8-b4b3-1835c4b4de35', '9e1acb59-83da-43f8-80aa-014cfd03ae20', 'b148ce84-de38-4536-8cd7-90c413c0a1a2', 'e8256fe9-e034-42af-8567-1bf328cfb5a9'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:41:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:51 devstack sudo[95045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:41:51 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:51 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.304s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:51 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:41:51 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Deleted volume successfully.
Sep 16 08:41:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ef29ca41-dad1-4f23-9cd9-c4d9a0fa5371 tempest-VolumesTransfersTest-1284221881 None] Lock "cinder-b50b19c4-5922-4fde-b797-1baa8ec47ae3-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Flow 'volume_create_manager' (e6690185-f4f6-4b8f-8910-808ba7fe96a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18371f9-1fab-4ff4-8c39-33264c2c75f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18371f9-1fab-4ff4-8c39-33264c2c75f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-515426748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e219f3-82ad-4d25-8aaf-a73298a0bdaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7ddc07a8ce4ab6b872d4ddff450839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:41:53Z,use_quota=True,user_id='fdede095c7554819a0334435d501b132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a16687b-8b34-4a7c-8078-97779ec4c1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a16687b-8b34-4a7c-8078-97779ec4c1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d9c012-9604-4aa5-84fb-055e2d0ad431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d9c012-9604-4aa5-84fb-055e2d0ad431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e219f3-82ad-4d25-8aaf-a73298a0bdaa', 'volume_name': 'volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7523303-2a5e-49dc-a1a2-e4985bfa1ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7523303-2a5e-49dc-a1a2-e4985bfa1ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a849fcaf-6019-4d2c-aee0-28f352342649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:52 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Volume d7e219f3-82ad-4d25-8aaf-a73298a0bdaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa', 'volume_size': 1}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-515426748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e219f3-82ad-4d25-8aaf-a73298a0bdaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7ddc07a8ce4ab6b872d4ddff450839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:41:53Z,use_quota=True,user_id='fdede095c7554819a0334435d501b132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Creating volume d7e219f3-82ad-4d25-8aaf-a73298a0bdaa {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:41:52 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:41:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:52 devstack sudo[95049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa 1073741824
Sep 16 08:41:52 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:53 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa 1073741824" returned: 0 in 0.566s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:53 devstack sudo[95061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa
Sep 16 08:41:53 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:53 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa" returned: 0 in 0.300s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:41:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a849fcaf-6019-4d2c-aee0-28f352342649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08ca3f8-3577-46ff-ae8a-1be3695049a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:41:53 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Volume volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa (d7e219f3-82ad-4d25-8aaf-a73298a0bdaa): created successfully
Sep 16 08:41:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08ca3f8-3577-46ff-ae8a-1be3695049a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:41:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Flow 'volume_create_manager' (e6690185-f4f6-4b8f-8910-808ba7fe96a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:41:53 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-576484f1-a0ad-4bb4-88eb-15eb1f95885b tempest-VolumesTransfersTest-1268695506 None] Created volume successfully.
Sep 16 08:41:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Acquiring lock "cinder-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Lock "cinder-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Acquiring lock "cinder-quobyte-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:41:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Lock "cinder-quobyte-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:41:55 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1e3d9c-1495-412a-b1e0-db6fdc0e87f1]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:41:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:55 devstack sudo[95065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa
Sep 16 08:41:55 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:56 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa" returned: 0 in 0.579s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:56 devstack sudo[95070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa
Sep 16 08:41:56 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:56 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa" returned: 0 in 0.325s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Lock "cinder-quobyte-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa" released by "delete_volume" :: held 0.962s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Created reservations ['203e3b4c-0373-4a6c-a750-17ec43083979', 'c342d60d-c55f-4738-8b15-430f616d02c2', '45b18272-1480-45f7-a92f-7a1c655e695f', 'abf1846b-e612-46ad-b581-4733dce63c18'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:41:56 devstack sudo[95073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:41:56 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:41:56 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.377s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:41:56 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Deleted volume successfully.
Sep 16 08:41:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a402beb6-f354-4148-b40a-90f6015628cf tempest-VolumesTransfersTest-1284221881 None] Lock "cinder-d7e219f3-82ad-4d25-8aaf-a73298a0bdaa-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Flow 'volume_create_manager' (ba8d4b47-2972-4d6c-ab01-cccf63b80963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695ed895-896a-4ed2-b555-8b4ae44a8d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695ed895-896a-4ed2-b555-8b4ae44a8d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1242994283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccde0f70-7ca8-459d-af3a-ba7bba164f23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='508b9303e34d4b21ae83ba62562c7683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:42:05Z,use_quota=True,user_id='072455dea1e9440b8a48933b1ac0cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6c9d6a-22ae-486f-81bc-f211814f17cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6c9d6a-22ae-486f-81bc-f211814f17cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1810dc-9cb4-480f-8be0-cd7a501fc44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1810dc-9cb4-480f-8be0-cd7a501fc44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccde0f70-7ca8-459d-af3a-ba7bba164f23', 'volume_name': 'volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d72dbd-b462-48d4-a0ba-977a1dee5c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d72dbd-b462-48d4-a0ba-977a1dee5c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa09c58-bcf3-4187-958d-188ee13076f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:05 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Volume ccde0f70-7ca8-459d-af3a-ba7bba164f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23', 'volume_size': 1}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1242994283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccde0f70-7ca8-459d-af3a-ba7bba164f23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='508b9303e34d4b21ae83ba62562c7683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:42:05Z,use_quota=True,user_id='072455dea1e9440b8a48933b1ac0cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Creating volume ccde0f70-7ca8-459d-af3a-ba7bba164f23 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:42:05 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:42:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:05 devstack sudo[95116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23 1073741824
Sep 16 08:42:05 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:06 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23 1073741824" returned: 0 in 0.822s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:06 devstack sudo[95126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23
Sep 16 08:42:06 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:06 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23" returned: 0 in 0.383s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:42:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa09c58-bcf3-4187-958d-188ee13076f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873da596-3181-495d-9aa1-80be989fcb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:06 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Volume volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23 (ccde0f70-7ca8-459d-af3a-ba7bba164f23): created successfully
Sep 16 08:42:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873da596-3181-495d-9aa1-80be989fcb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Flow 'volume_create_manager' (ba8d4b47-2972-4d6c-ab01-cccf63b80963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:42:06 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3280b397-47d4-4544-9f36-39eb1e51c83b tempest-VolumesTestJSON-31413037 None] Created volume successfully.
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Flow 'volume_create_manager' (35b9b50e-9f13-49a4-b28d-dfa788073504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1afced-0cb2-4fbc-bef9-2ba16de11e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1afced-0cb2-4fbc-bef9-2ba16de11e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-995510529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d0c207-bc4f-4627-8826-b33c89456ebd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='508b9303e34d4b21ae83ba62562c7683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:42:08Z,use_quota=True,user_id='072455dea1e9440b8a48933b1ac0cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf60a883-8fef-4d6b-85e1-c799321120d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf60a883-8fef-4d6b-85e1-c799321120d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9aacab-355d-4fb7-a33c-584021517690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9aacab-355d-4fb7-a33c-584021517690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d0c207-bc4f-4627-8826-b33c89456ebd', 'volume_name': 'volume-35d0c207-bc4f-4627-8826-b33c89456ebd', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577222a9-92cc-48ba-8474-1509efdfe712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577222a9-92cc-48ba-8474-1509efdfe712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30c44d6-14bf-45a5-8b0e-a7d5c8f780a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:08 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Volume 35d0c207-bc4f-4627-8826-b33c89456ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d0c207-bc4f-4627-8826-b33c89456ebd', 'volume_size': 1}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-995510529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d0c207-bc4f-4627-8826-b33c89456ebd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='508b9303e34d4b21ae83ba62562c7683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:42:08Z,use_quota=True,user_id='072455dea1e9440b8a48933b1ac0cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Creating volume 35d0c207-bc4f-4627-8826-b33c89456ebd {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:42:08 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35d0c207-bc4f-4627-8826-b33c89456ebd 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:08 devstack sudo[95130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35d0c207-bc4f-4627-8826-b33c89456ebd 1073741824
Sep 16 08:42:08 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:08 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35d0c207-bc4f-4627-8826-b33c89456ebd 1073741824" returned: 0 in 0.739s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35d0c207-bc4f-4627-8826-b33c89456ebd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:09 devstack sudo[95190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35d0c207-bc4f-4627-8826-b33c89456ebd
Sep 16 08:42:09 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:09 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35d0c207-bc4f-4627-8826-b33c89456ebd" returned: 0 in 0.469s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:42:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30c44d6-14bf-45a5-8b0e-a7d5c8f780a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d0c207-bc4f-4627-8826-b33c89456ebd', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f640f47-5034-40f0-ba4e-1f66e7615984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:09 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Volume volume-35d0c207-bc4f-4627-8826-b33c89456ebd (35d0c207-bc4f-4627-8826-b33c89456ebd): created successfully
Sep 16 08:42:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f640f47-5034-40f0-ba4e-1f66e7615984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Flow 'volume_create_manager' (35b9b50e-9f13-49a4-b28d-dfa788073504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:42:09 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8bbd11fc-f610-4cf1-b1d0-12ecde370556 tempest-VolumesTestJSON-31413037 None] Created volume successfully.
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Flow 'volume_create_manager' (9107d584-30b9-4803-b77b-8d6371e888e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca89c2ef-1272-4487-9621-472d4cd9dda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca89c2ef-1272-4487-9621-472d4cd9dda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-408319079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6dcceb-de86-4e66-a51b-9e5fd065d36d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='508b9303e34d4b21ae83ba62562c7683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:42:12Z,use_quota=True,user_id='072455dea1e9440b8a48933b1ac0cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a4c9a5-abee-40e2-9a0a-34d2bd2cc9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a4c9a5-abee-40e2-9a0a-34d2bd2cc9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f50f114-4350-4385-80c8-900dcf8e74a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f50f114-4350-4385-80c8-900dcf8e74a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a6dcceb-de86-4e66-a51b-9e5fd065d36d', 'volume_name': 'volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbed871-7089-4276-9c3a-691f78dc7621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbed871-7089-4276-9c3a-691f78dc7621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3af81a-3cfe-4bd1-bc08-0112fb547903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:11 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Volume 6a6dcceb-de86-4e66-a51b-9e5fd065d36d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d', 'volume_size': 1}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-408319079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6dcceb-de86-4e66-a51b-9e5fd065d36d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='508b9303e34d4b21ae83ba62562c7683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:42:12Z,use_quota=True,user_id='072455dea1e9440b8a48933b1ac0cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Creating volume 6a6dcceb-de86-4e66-a51b-9e5fd065d36d {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:42:11 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:42:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:12 devstack sudo[95246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d 1073741824
Sep 16 08:42:12 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:42:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:42:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:42:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:12 devstack sudo[95251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:42:12 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:13 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d 1073741824" returned: 0 in 1.103s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:13 devstack sudo[95256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d
Sep 16 08:42:13 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:13 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.586s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:42:13 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d" returned: 0 in 0.619s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3af81a-3cfe-4bd1-bc08-0112fb547903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7391d084-e179-4a9c-a00a-2356120ea62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:13 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Volume volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d (6a6dcceb-de86-4e66-a51b-9e5fd065d36d): created successfully
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7391d084-e179-4a9c-a00a-2356120ea62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Flow 'volume_create_manager' (9107d584-30b9-4803-b77b-8d6371e888e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:42:14 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3d815885-0fc5-4d38-87fe-e99d17b85903 tempest-VolumesTestJSON-31413037 None] Created volume successfully.
Sep 16 08:42:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Acquiring lock "cinder-6a6dcceb-de86-4e66-a51b-9e5fd065d36d-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:42:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Lock "cinder-6a6dcceb-de86-4e66-a51b-9e5fd065d36d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:42:17 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=99,cinder:UPDATE=112,cinder:INSERT=22,cinder:DELETE=11 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:42:17 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=91,cinder:UPDATE=117,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:42:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Acquiring lock "cinder-quobyte-6a6dcceb-de86-4e66-a51b-9e5fd065d36d" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:42:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Lock "cinder-quobyte-6a6dcceb-de86-4e66-a51b-9e5fd065d36d" acquired by "delete_volume" :: waited 0.045s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:42:17 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d79e70-3ff2-4b94-bd3c-32ffc63d1416]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:42:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:17 devstack sudo[95261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d
Sep 16 08:42:17 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:18 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d" returned: 0 in 0.743s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:18 devstack sudo[95266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d
Sep 16 08:42:18 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:18 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6a6dcceb-de86-4e66-a51b-9e5fd065d36d" returned: 0 in 0.615s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Lock "cinder-quobyte-6a6dcceb-de86-4e66-a51b-9e5fd065d36d" released by "delete_volume" :: held 1.443s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:42:18 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Created reservations ['89d040e6-6ac5-435c-b3e6-138c73ff87ff', 'c9dd879c-93a6-4c68-a889-81c7578b9d23', 'c0cf3723-7ed7-4226-b0b0-895027d91b23', '74ba31ef-1cba-46f2-a601-570cd59f5269'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:19 devstack sudo[95269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:42:19 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:19 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.428s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:42:19 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Deleted volume successfully.
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-94ea45fc-77ed-4b9f-9f9b-cc91ac363a1f tempest-VolumesTestJSON-31413037 None] Lock "cinder-6a6dcceb-de86-4e66-a51b-9e5fd065d36d-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Acquiring lock "cinder-35d0c207-bc4f-4627-8826-b33c89456ebd-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Lock "cinder-35d0c207-bc4f-4627-8826-b33c89456ebd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Acquiring lock "cinder-quobyte-35d0c207-bc4f-4627-8826-b33c89456ebd" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:42:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Lock "cinder-quobyte-35d0c207-bc4f-4627-8826-b33c89456ebd" acquired by "delete_volume" :: waited 0.040s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:42:20 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[18894782-b7c3-4a28-b73b-23de0981252d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:42:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35d0c207-bc4f-4627-8826-b33c89456ebd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:20 devstack sudo[95272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35d0c207-bc4f-4627-8826-b33c89456ebd
Sep 16 08:42:20 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:20 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35d0c207-bc4f-4627-8826-b33c89456ebd" returned: 0 in 0.681s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35d0c207-bc4f-4627-8826-b33c89456ebd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:20 devstack sudo[95277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35d0c207-bc4f-4627-8826-b33c89456ebd
Sep 16 08:42:20 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:21 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35d0c207-bc4f-4627-8826-b33c89456ebd" returned: 0 in 0.450s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Lock "cinder-quobyte-35d0c207-bc4f-4627-8826-b33c89456ebd" released by "delete_volume" :: held 1.210s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:42:21 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Created reservations ['356c1237-41b6-49ed-8cd9-578a882c94be', '0c28379e-6f74-4438-af3a-4c3624b81b22', '83136336-1951-4f88-a995-149dbf5c49b2', '325249ec-b4cd-42d9-a2df-7fa3a8e1ae21'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:42:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:42:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:42:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:21 devstack sudo[95281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:42:21 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:21 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.443s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:21 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:42:21 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Deleted volume successfully.
Sep 16 08:42:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-03a7a95e-e5eb-4afd-9aec-aeed0d714b9d tempest-VolumesTestJSON-31413037 None] Lock "cinder-35d0c207-bc4f-4627-8826-b33c89456ebd-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:42:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Acquiring lock "cinder-ccde0f70-7ca8-459d-af3a-ba7bba164f23-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:42:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Lock "cinder-ccde0f70-7ca8-459d-af3a-ba7bba164f23-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:42:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Acquiring lock "cinder-quobyte-ccde0f70-7ca8-459d-af3a-ba7bba164f23" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:42:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Lock "cinder-quobyte-ccde0f70-7ca8-459d-af3a-ba7bba164f23" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:42:22 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9cef0d-200f-49a9-9911-399aee057f2d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:42:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:22 devstack sudo[95284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23
Sep 16 08:42:22 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:23 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23" returned: 0 in 1.014s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:23 devstack sudo[95289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23
Sep 16 08:42:23 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:23 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ccde0f70-7ca8-459d-af3a-ba7bba164f23" returned: 0 in 0.331s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Lock "cinder-quobyte-ccde0f70-7ca8-459d-af3a-ba7bba164f23" released by "delete_volume" :: held 1.471s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:42:24 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Created reservations ['866d9666-70f3-42a4-a873-50087443d62b', '44c8ebfc-dcd7-457c-a46a-7f5d46827a47', '6dd98ae1-48a2-4989-a42a-8a43f9ddc9d4', '846cc592-8ade-47a8-87e2-541ffbd2f581'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:42:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:42:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:42:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:24 devstack sudo[95312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:42:24 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:24 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.494s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:24 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:42:24 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Deleted volume successfully.
Sep 16 08:42:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f1c0382-d51a-4960-a225-5fc0c0e878cd tempest-VolumesTestJSON-31413037 None] Lock "cinder-ccde0f70-7ca8-459d-af3a-ba7bba164f23-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:42:34 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:42:34 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=12,cinder:INSERT=6,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Flow 'volume_create_manager' (5633cff3-c9f8-4c38-a45a-3b521f4c090e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0610412-9bdb-407d-87b9-71b94550f194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0610412-9bdb-407d-87b9-71b94550f194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1023153589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22be144d-5ce6-4285-a14c-1437e4a9ba48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ef44ae666c4f58885fcca9d2fa85cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:42:46Z,use_quota=True,user_id='1b69a35543584a00909eed98687b1484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a35ce5-ee23-4777-bc5f-d9f4ef95c2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a35ce5-ee23-4777-bc5f-d9f4ef95c2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbeecb7-dee0-4bce-886f-874a5d85ee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbeecb7-dee0-4bce-886f-874a5d85ee0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22be144d-5ce6-4285-a14c-1437e4a9ba48', 'volume_name': 'volume-22be144d-5ce6-4285-a14c-1437e4a9ba48', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d74f88-d01c-4193-8a7a-0ec507a7c095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d74f88-d01c-4193-8a7a-0ec507a7c095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02347c8-26ec-493c-b884-f26ef70cefce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:45 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Volume 22be144d-5ce6-4285-a14c-1437e4a9ba48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22be144d-5ce6-4285-a14c-1437e4a9ba48', 'volume_size': 1}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1023153589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22be144d-5ce6-4285-a14c-1437e4a9ba48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ef44ae666c4f58885fcca9d2fa85cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:42:46Z,use_quota=True,user_id='1b69a35543584a00909eed98687b1484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Creating volume 22be144d-5ce6-4285-a14c-1437e4a9ba48 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:42:45 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:42:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-22be144d-5ce6-4285-a14c-1437e4a9ba48 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:46 devstack sudo[95434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-22be144d-5ce6-4285-a14c-1437e4a9ba48 1073741824
Sep 16 08:42:46 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:46 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-22be144d-5ce6-4285-a14c-1437e4a9ba48 1073741824" returned: 0 in 0.693s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-22be144d-5ce6-4285-a14c-1437e4a9ba48 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:46 devstack sudo[95440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-22be144d-5ce6-4285-a14c-1437e4a9ba48
Sep 16 08:42:46 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:47 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-22be144d-5ce6-4285-a14c-1437e4a9ba48" returned: 0 in 0.350s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:42:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02347c8-26ec-493c-b884-f26ef70cefce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22be144d-5ce6-4285-a14c-1437e4a9ba48', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ee37da-f0b7-4d85-ae67-5a3a8e89bd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:47 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Volume volume-22be144d-5ce6-4285-a14c-1437e4a9ba48 (22be144d-5ce6-4285-a14c-1437e4a9ba48): created successfully
Sep 16 08:42:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ee37da-f0b7-4d85-ae67-5a3a8e89bd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Flow 'volume_create_manager' (5633cff3-c9f8-4c38-a45a-3b521f4c090e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:42:47 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7db5387d-fe3d-450a-8497-aec291998d97 tempest-ServerRescueNegativeTestJSON-1901575080 None] Created volume successfully.
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Flow 'volume_create_manager' (b970fc3f-2187-432c-b80f-808a83e43787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965f8703-cb08-4989-84f2-66ee09db826f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965f8703-cb08-4989-84f2-66ee09db826f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-967100680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47d38ef-8567-401e-a4c9-cd75570e23b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b503853278eb449b8283fcf13e460b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:42:52Z,use_quota=True,user_id='97a403b275d44a64b8fa0721739de65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d03a9c-9b11-4207-b96b-eb8608c8328c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d03a9c-9b11-4207-b96b-eb8608c8328c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd37db60-ab95-4ece-b952-6b7c8dd3d814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd37db60-ab95-4ece-b952-6b7c8dd3d814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e47d38ef-8567-401e-a4c9-cd75570e23b8', 'volume_name': 'volume-e47d38ef-8567-401e-a4c9-cd75570e23b8', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1420c4ca-bb90-4739-ae58-3e0797855eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1420c4ca-bb90-4739-ae58-3e0797855eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af61e6c-c437-410b-803b-7c125de618b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:52 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Volume e47d38ef-8567-401e-a4c9-cd75570e23b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e47d38ef-8567-401e-a4c9-cd75570e23b8', 'volume_size': 1}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-967100680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47d38ef-8567-401e-a4c9-cd75570e23b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b503853278eb449b8283fcf13e460b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:42:52Z,use_quota=True,user_id='97a403b275d44a64b8fa0721739de65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Creating volume e47d38ef-8567-401e-a4c9-cd75570e23b8 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:42:52 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:42:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:52 devstack sudo[95486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 1073741824
Sep 16 08:42:52 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:53 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 1073741824" returned: 0 in 0.885s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:53 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8
Sep 16 08:42:53 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:54 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8" returned: 0 in 0.557s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:42:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af61e6c-c437-410b-803b-7c125de618b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47d38ef-8567-401e-a4c9-cd75570e23b8', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145a99aa-1e91-44af-abd8-8e931db55ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:54 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Volume volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 (e47d38ef-8567-401e-a4c9-cd75570e23b8): created successfully
Sep 16 08:42:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145a99aa-1e91-44af-abd8-8e931db55ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Flow 'volume_create_manager' (b970fc3f-2187-432c-b80f-808a83e43787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:42:54 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-397aa1b1-e8e5-451a-94d0-ff1ecbcddc7a tempest-TestStampPattern-1424016276 None] Created volume successfully.
Sep 16 08:42:55 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Flow 'volume_create_manager' (986b7309-e07e-402c-b73a-e2d5e20258ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa85537-c388-4e26-a52f-c6668ae00eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa85537-c388-4e26-a52f-c6668ae00eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-852472074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb0997e2-ecf3-4915-9741-a7cc0eb1e18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef12fc3de3544a4bb03345a78830eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:42:56Z,use_quota=True,user_id='2f307fb1cdf445db8b126d9beab6e07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32add14-cfc8-431c-8f08-9572ea94ee86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32add14-cfc8-431c-8f08-9572ea94ee86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20b73dd-4c00-4dfb-9fd3-239d89ed5139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20b73dd-4c00-4dfb-9fd3-239d89ed5139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb0997e2-ecf3-4915-9741-a7cc0eb1e18d', 'volume_name': 'volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a8cd2b-1402-4ce0-91e9-7eed69209d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a8cd2b-1402-4ce0-91e9-7eed69209d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1cea998-4512-4099-8748-5a72895c3452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:56 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Volume cb0997e2-ecf3-4915-9741-a7cc0eb1e18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d', 'volume_size': 1}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-852472074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb0997e2-ecf3-4915-9741-a7cc0eb1e18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef12fc3de3544a4bb03345a78830eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:42:56Z,use_quota=True,user_id='2f307fb1cdf445db8b126d9beab6e07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Creating volume cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:42:56 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:42:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:56 devstack sudo[95505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d 1073741824
Sep 16 08:42:56 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:56 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d 1073741824" returned: 0 in 0.890s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:57 devstack sudo[95510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d
Sep 16 08:42:57 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:57 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" returned: 0 in 0.579s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:42:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:42:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1cea998-4512-4099-8748-5a72895c3452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39c5053-3cdb-4639-90f0-e8136d77b6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:42:57 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Volume volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d (cb0997e2-ecf3-4915-9741-a7cc0eb1e18d): created successfully
Sep 16 08:42:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39c5053-3cdb-4639-90f0-e8136d77b6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:42:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Flow 'volume_create_manager' (986b7309-e07e-402c-b73a-e2d5e20258ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:42:57 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f061a167-4300-4a9e-bba2-6abf1e76ef42 tempest-SnapshotsActionsTest-1558031737 None] Created volume successfully.
Sep 16 08:42:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:42:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:42:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] Creating offline snapshot 82273c0d-8a8f-4337-b575-ab92821392ea of volume cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:42:58 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b344856-e447-4c35-9248-cf63aacb78e8]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:42:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:59 devstack sudo[95548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d
Sep 16 08:42:59 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:42:59 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root
Sep 16 08:42:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" returned: 0 in 0.792s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:42:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:42:59 devstack sudo[95566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea 1G
Sep 16 08:42:59 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:00 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea 1G" returned: 0 in 1.165s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:00 devstack sudo[95573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:00 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:01 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 0.785s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:01 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea is being set with open permissions: ugo+rw
Sep 16 08:43:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:01 devstack sudo[95579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:01 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:01 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 0.495s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:02 devstack sudo[95586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.info
Sep 16 08:43:02 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:02 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.info" returned: 0 in 0.504s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:02 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.info is being set with open permissions: ugo+rw
Sep 16 08:43:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:02 devstack sudo[95600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.info
Sep 16 08:43:02 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Acquiring lock "cinder-22be144d-5ce6-4285-a14c-1437e4a9ba48-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Lock "cinder-22be144d-5ce6-4285-a14c-1437e4a9ba48-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:03 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Acquiring lock "cinder-quobyte-22be144d-5ce6-4285-a14c-1437e4a9ba48" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:03 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Lock "cinder-quobyte-22be144d-5ce6-4285-a14c-1437e4a9ba48" acquired by "delete_volume" :: waited 0.034s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:03 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e92b613-0160-4166-8263-8dd8b92456c5]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-22be144d-5ce6-4285-a14c-1437e4a9ba48 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:03 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.info" returned: 0 in 0.709s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.672s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:03 devstack sudo[95606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-22be144d-5ce6-4285-a14c-1437e4a9ba48
Sep 16 08:43:03 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:03 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-af8da268-a14e-46e7-a1be-718d30aeee9d tempest-SnapshotsActionsTest-1558031737 None] Create snapshot completed successfully
Sep 16 08:43:03 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-22be144d-5ce6-4285-a14c-1437e4a9ba48" returned: 0 in 0.655s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-22be144d-5ce6-4285-a14c-1437e4a9ba48 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:04 devstack sudo[95621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-22be144d-5ce6-4285-a14c-1437e4a9ba48
Sep 16 08:43:04 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:04 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-22be144d-5ce6-4285-a14c-1437e4a9ba48" returned: 0 in 1.000s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:04 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Lock "cinder-quobyte-22be144d-5ce6-4285-a14c-1437e4a9ba48" released by "delete_volume" :: held 1.770s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:05 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Created reservations ['c3b2f670-5c85-46a5-84bf-8acf8f8997c2', '40b11735-0941-4177-9ef1-a909ae883251', '4f593b74-5c5a-4efd-91d0-137953330856', '09af5fd6-760c-40e6-9ce4-7ee4221a673e'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:43:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:43:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:43:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:05 devstack sudo[95686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:43:05 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.771s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:06 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:06 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:43:06 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Deleted volume successfully.
Sep 16 08:43:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5414f0c9-ed97-443d-a4ee-a8c6507c22ae tempest-ServerRescueNegativeTestJSON-1901575080 None] Lock "cinder-22be144d-5ce6-4285-a14c-1437e4a9ba48-delete_volume" released by "delete_volume" :: held 3.308s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] Creating offline snapshot 61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9 of volume cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:43:06 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b060f029-0c68-4853-9dfa-927947ba7cf2]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:06 devstack sudo[95699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:06 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:07 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 0.998s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:07 devstack sudo[95725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9 1G
Sep 16 08:43:07 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:08 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9 1G" returned: 0 in 1.110s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:08 devstack sudo[95735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9
Sep 16 08:43:08 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:09 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9" returned: 0 in 0.727s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:09 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9 is being set with open permissions: ugo+rw
Sep 16 08:43:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:09 devstack sudo[95741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9
Sep 16 08:43:09 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:09 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9" returned: 0 in 0.592s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.755s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:10 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d1bbf30e-5b65-485e-bda7-4caa6fc7bdec tempest-SnapshotsActionsTest-1558031737 None] Create snapshot completed successfully
Sep 16 08:43:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Acquiring lock "cinder-61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Acquiring lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" acquired by "delete_snapshot" :: waited 0.089s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Acquiring lock "cinder-quobyte-61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9" acquired by "_delete_snapshot" :: waited 0.086s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Deleting offline snapshot 61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9 of volume cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:43:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] snapshot_file for this snap is: volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:43:11 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2b1436-7146-4d6e-bbe7-779172331640]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:12 devstack sudo[95801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9
Sep 16 08:43:12 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:43:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:43:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:43:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:12 devstack sudo[95815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:43:12 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:12 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9" returned: 0 in 1.210s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:13 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76c2f75-0dfc-48a2-9dd9-375c5f73e54b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:13 devstack sudo[95821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:13 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:13 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.920s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:43:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:43:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:43:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:43:13 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 0.725s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:13 devstack sudo[95829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9
Sep 16 08:43:13 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:15 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9" returned: 0 in 1.296s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:15 devstack sudo[95853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9
Sep 16 08:43:15 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:15 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9" returned: 0 in 0.373s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9" released by "_delete_snapshot" :: held 3.971s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" released by "delete_snapshot" :: held 4.072s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:15 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Created reservations ['16c17a1c-aac4-4838-8edb-d8d294d201c7', 'a27bad11-8927-4b20-8d3d-0c5367ce885b', '23ff3f1c-aa24-4cfa-86c5-325a8b8efa7a', 'd6ad5e48-1f6e-4dfa-b57d-974c385db223'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:43:15 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Delete snapshot completed successfully.
Sep 16 08:43:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ec612c59-eb01-462e-b144-97f05a82698b tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-61ec83fe-a81d-40cf-ab7b-d5e3a4cfd9d9-delete_snapshot" released by "delete_snapshot" :: held 4.471s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] Creating offline snapshot 0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f of volume cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:43:17 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3279b18b-808e-4a36-b002-4514d6f45926]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:17 devstack sudo[95860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:17 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:18 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 1.005s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:18 devstack sudo[95866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f 1G
Sep 16 08:43:18 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:19 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f 1G" returned: 0 in 1.085s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:19 devstack sudo[95871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f
Sep 16 08:43:19 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:19 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f" returned: 0 in 0.556s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:19 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f is being set with open permissions: ugo+rw
Sep 16 08:43:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:19 devstack sudo[95876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f
Sep 16 08:43:19 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:19 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Flow 'volume_create_manager' (b2655b8a-2507-4e66-88ca-4f97f077d2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d75f76-4f72-408f-a2bd-38615a65bd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d75f76-4f72-408f-a2bd-38615a65bd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1416416896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e38032-58e0-4533-a7d6-745cf261453a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6d81627e6e4663a8423b5b6632cbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:43:20Z,use_quota=True,user_id='f92d7f44b4194d16bc7a452cdf08f6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7aee61e-9b35-43e5-a321-e3d20b5d4b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7aee61e-9b35-43e5-a321-e3d20b5d4b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7ed8da-a4ab-4e56-9668-70a7d86de33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7ed8da-a4ab-4e56-9668-70a7d86de33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e38032-58e0-4533-a7d6-745cf261453a', 'volume_name': 'volume-20e38032-58e0-4533-a7d6-745cf261453a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afe2df4-7efd-4a6f-96f4-ce311c0ea93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afe2df4-7efd-4a6f-96f4-ce311c0ea93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955c2dbf-0d1c-4675-91d0-d4fea4ec274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:43:20 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Volume 20e38032-58e0-4533-a7d6-745cf261453a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e38032-58e0-4533-a7d6-745cf261453a', 'volume_size': 1}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:20 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f" returned: 0 in 0.452s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.401s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.076s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1416416896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e38032-58e0-4533-a7d6-745cf261453a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6d81627e6e4663a8423b5b6632cbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:43:20Z,use_quota=True,user_id='f92d7f44b4194d16bc7a452cdf08f6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Creating volume 20e38032-58e0-4533-a7d6-745cf261453a {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:43:20 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-20e38032-58e0-4533-a7d6-745cf261453a 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:20 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-97669177-cb45-4967-8d16-7dc00175c709 tempest-SnapshotsActionsTest-1558031737 None] Create snapshot completed successfully
Sep 16 08:43:20 devstack sudo[95879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-20e38032-58e0-4533-a7d6-745cf261453a 1073741824
Sep 16 08:43:20 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:20 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-20e38032-58e0-4533-a7d6-745cf261453a 1073741824" returned: 0 in 0.561s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-20e38032-58e0-4533-a7d6-745cf261453a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:20 devstack sudo[95886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-20e38032-58e0-4533-a7d6-745cf261453a
Sep 16 08:43:20 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:21 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-20e38032-58e0-4533-a7d6-745cf261453a" returned: 0 in 0.361s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955c2dbf-0d1c-4675-91d0-d4fea4ec274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e38032-58e0-4533-a7d6-745cf261453a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac45bd6-50ae-40b5-9110-7219eb5ac79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:43:21 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Volume volume-20e38032-58e0-4533-a7d6-745cf261453a (20e38032-58e0-4533-a7d6-745cf261453a): created successfully
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac45bd6-50ae-40b5-9110-7219eb5ac79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Flow 'volume_create_manager' (b2655b8a-2507-4e66-88ca-4f97f077d2bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:43:21 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3b0d0454-b663-4fa9-b756-5f611eca8b7f tempest-TestMinimumBasicScenario-358967882 None] Created volume successfully.
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Acquiring lock "cinder-0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Acquiring lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Acquiring lock "cinder-quobyte-0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Deleting offline snapshot 0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f of volume cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] snapshot_file for this snap is: volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c048fd6a-460d-4715-9e5d-b9dd3154985b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:21 devstack sudo[95891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f
Sep 16 08:43:21 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:22 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f" returned: 0 in 0.695s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:22 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb68508f-4abe-49eb-a46e-43b132314787]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:22 devstack sudo[95927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:22 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:22 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 0.631s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:23 devstack sudo[95934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f
Sep 16 08:43:23 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:23 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f" returned: 0 in 0.479s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-15570209-51a6-449e-998a-8b65be32bbab req-e0654300-ca41-4013-8371-9ddb04f4560f tempest-TestMinimumBasicScenario-358967882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-15570209-51a6-449e-998a-8b65be32bbab req-e0654300-ca41-4013-8371-9ddb04f4560f tempest-TestMinimumBasicScenario-358967882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-15570209-51a6-449e-998a-8b65be32bbab req-e0654300-ca41-4013-8371-9ddb04f4560f tempest-TestMinimumBasicScenario-358967882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:23 devstack sudo[95947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f
Sep 16 08:43:23 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-15570209-51a6-449e-998a-8b65be32bbab req-e0654300-ca41-4013-8371-9ddb04f4560f tempest-TestMinimumBasicScenario-358967882 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-20e38032-58e0-4533-a7d6-745cf261453a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fc6c3fc-77bd-4e64-b9c5-e6d473750188', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:43:23 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-15570209-51a6-449e-998a-8b65be32bbab req-e0654300-ca41-4013-8371-9ddb04f4560f tempest-TestMinimumBasicScenario-358967882 None] attachment_update completed successfully.
Sep 16 08:43:23 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f" returned: 0 in 0.457s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f" released by "_delete_snapshot" :: held 2.420s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" released by "delete_snapshot" :: held 2.476s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:24 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Created reservations ['250c6c6c-369e-4718-9b7d-de815e074cfd', 'f2dd12b1-4049-4a98-9d60-6a176fad023f', '7df3ef3a-be6c-4759-8b48-ae05fa505eb1', 'cdc1ec11-e8eb-4fa1-8ea8-b004ecace511'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:43:24 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Delete snapshot completed successfully.
Sep 16 08:43:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7ba1ee4c-70bb-4853-9655-77b0a2d874d6 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-0ba202bd-d9e5-4cb6-a16b-5a2effd7b37f-delete_snapshot" released by "delete_snapshot" :: held 2.788s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] Creating offline snapshot 78ad0724-6ffb-4594-b198-d66e46f9d4ad of volume cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:43:25 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9563b7-af89-4abd-96e1-cc5540f3a476]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:25 devstack sudo[96363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:25 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:25 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 0.498s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:25 devstack sudo[96369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad 1G
Sep 16 08:43:25 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:26 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad 1G" returned: 0 in 0.623s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:26 devstack sudo[96375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad
Sep 16 08:43:26 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:26 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad" returned: 0 in 0.367s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:26 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad is being set with open permissions: ugo+rw
Sep 16 08:43:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:26 devstack sudo[96381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad
Sep 16 08:43:26 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:27 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad" returned: 0 in 0.403s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-58ef8209-a903-4985-bc4a-826b3d9542f7 tempest-SnapshotsActionsTest-1558031737 None] Create snapshot completed successfully
Sep 16 08:43:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Acquiring lock "cinder-78ad0724-6ffb-4594-b198-d66e46f9d4ad-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-78ad0724-6ffb-4594-b198-d66e46f9d4ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Acquiring lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Acquiring lock "cinder-quobyte-78ad0724-6ffb-4594-b198-d66e46f9d4ad" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-78ad0724-6ffb-4594-b198-d66e46f9d4ad" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Deleting offline snapshot 78ad0724-6ffb-4594-b198-d66e46f9d4ad of volume cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:43:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] snapshot_file for this snap is: volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:43:28 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a89198c-e2ac-4475-9b3c-b48c87192522]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:28 devstack sudo[96410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad
Sep 16 08:43:28 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:29 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad" returned: 0 in 0.642s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:29 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e516e8-3ee5-4490-a8e3-ee74c6aa4d91]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:29 devstack sudo[96417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:29 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:30 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 0.615s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:30 devstack sudo[96422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad
Sep 16 08:43:30 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-fc5b9594-687c-4bd4-be10-c4fa66824e83 tempest-GroupSnapshotsTest-621664314 None] Group tempest-GroupSnapshotsTest-Group-1241008482: creating
Sep 16 08:43:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-fc5b9594-687c-4bd4-be10-c4fa66824e83 tempest-GroupSnapshotsTest-621664314 None] Group tempest-GroupSnapshotsTest-Group-1241008482: created successfully
Sep 16 08:43:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-fc5b9594-687c-4bd4-be10-c4fa66824e83 tempest-GroupSnapshotsTest-621664314 None] Create group completed successfully.
Sep 16 08:43:30 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad" returned: 0 in 0.523s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:30 devstack sudo[96428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad
Sep 16 08:43:30 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:30 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.78ad0724-6ffb-4594-b198-d66e46f9d4ad" returned: 0 in 0.297s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-78ad0724-6ffb-4594-b198-d66e46f9d4ad" released by "_delete_snapshot" :: held 2.255s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" released by "delete_snapshot" :: held 2.284s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:31 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Created reservations ['a9b6d42a-5680-4e28-bc11-f9f34dd29d0c', '77b2277e-804f-4d2d-8808-424a53ed1464', 'a7463bb5-db14-454d-bfb5-260bb7537729', '92287679-e319-4e11-9e5f-314ed578fcfe'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:43:31 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Delete snapshot completed successfully.
Sep 16 08:43:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f7633c4-31db-48a2-ba16-c24d2341f234 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-78ad0724-6ffb-4594-b198-d66e46f9d4ad-delete_snapshot" released by "delete_snapshot" :: held 2.502s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Flow 'volume_create_manager' (cd9d5021-9ab1-439f-9ab9-1839270fcb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94225393-f55a-4e05-9836-61f35c2cef56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94225393-f55a-4e05-9836-61f35c2cef56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-785889286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d268c98c-204c-49f8-aaa7-32d9f4ac71b5,host='devstack@QuobyteHD#QuobyteHD',id=f617b80b-e72a-4eae-bb95-63b2b0c0bcae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b923d0c0e94d2981e44bacca51b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:43:32Z,use_quota=True,user_id='7ceaf93bccb64571b27e1f2f0248d117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93a043d5-1b60-4826-95f5-414cb0f6b4d3),volume_type_id=93a043d5-1b60-4826-95f5-414cb0f6b4d3)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece01e30-65df-4775-bc90-a8934aa762d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece01e30-65df-4775-bc90-a8934aa762d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac778fe-deae-4982-befb-597515c9d12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac778fe-deae-4982-befb-597515c9d12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f617b80b-e72a-4eae-bb95-63b2b0c0bcae', 'volume_name': 'volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c8d826-19ee-43e7-a914-9747dbffc5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c8d826-19ee-43e7-a914-9747dbffc5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0bf027-8922-4286-acfb-75f885f63629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:43:32 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Volume f617b80b-e72a-4eae-bb95-63b2b0c0bcae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae', 'volume_size': 1}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d268c98c-204c-49f8-aaa7-32d9f4ac71b5,created_at=2026-09-16T06:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-785889286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d268c98c-204c-49f8-aaa7-32d9f4ac71b5,host='devstack@QuobyteHD#QuobyteHD',id=f617b80b-e72a-4eae-bb95-63b2b0c0bcae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b923d0c0e94d2981e44bacca51b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:43:32Z,use_quota=True,user_id='7ceaf93bccb64571b27e1f2f0248d117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93a043d5-1b60-4826-95f5-414cb0f6b4d3),volume_type_id=93a043d5-1b60-4826-95f5-414cb0f6b4d3)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Creating volume f617b80b-e72a-4eae-bb95-63b2b0c0bcae {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:43:32 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:32 devstack sudo[96436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae 1073741824
Sep 16 08:43:32 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:32 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae 1073741824" returned: 0 in 0.568s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:33 devstack sudo[96446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae
Sep 16 08:43:33 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-1cee227a-5702-41aa-b8d1-301e8a6752e0 req-e4c56681-fd17-4f47-b795-196a523e4784 tempest-TestStampPattern-1424016276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:33 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae" returned: 0 in 0.369s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.884s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0bf027-8922-4286-acfb-75f885f63629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ca0c34-4cfa-42e9-b4a0-163a79fa84e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] Creating offline snapshot 8c56e262-badf-4b06-9de9-39199c8de86b of volume cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:43:33 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Volume volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae (f617b80b-e72a-4eae-bb95-63b2b0c0bcae): created successfully
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ca0c34-4cfa-42e9-b4a0-163a79fa84e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Flow 'volume_create_manager' (cd9d5021-9ab1-439f-9ab9-1839270fcb76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44471a2-f687-48a8-b6e9-40aafb768e1b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:33 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1cda456e-e803-4a2a-a6a2-6761e1bd7055 tempest-GroupSnapshotsTest-621664314 None] Created volume successfully.
Sep 16 08:43:33 devstack sudo[96458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:33 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:33 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 0.373s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:33 devstack sudo[96463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b 1G
Sep 16 08:43:33 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:34 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b 1G" returned: 0 in 0.422s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:34 devstack sudo[96472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b
Sep 16 08:43:34 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:34 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b" returned: 0 in 0.301s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:34 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b is being set with open permissions: ugo+rw
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:34 devstack sudo[96477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b
Sep 16 08:43:34 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] GroupSnapshot 95a24123-76fd-4d26-83a9-d7828d87263a: creating.
Sep 16 08:43:34 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b" returned: 0 in 0.271s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] Group snapshot 95a24123-76fd-4d26-83a9-d7828d87263a: creating. {{(pid=86261) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.519s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-1cee227a-5702-41aa-b8d1-301e8a6752e0 req-e4c56681-fd17-4f47-b795-196a523e4784 tempest-TestStampPattern-1424016276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.578s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-1cee227a-5702-41aa-b8d1-301e8a6752e0 req-e4c56681-fd17-4f47-b795-196a523e4784 tempest-TestStampPattern-1424016276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.016s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3a9d58c2-810a-4442-8f11-e5899707d324 tempest-SnapshotsActionsTest-1558031737 None] Create snapshot completed successfully
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] Creating offline snapshot 6746d811-c213-43f9-b0a5-171d2fa5329c of volume f617b80b-e72a-4eae-bb95-63b2b0c0bcae {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ce0721-6e62-422a-8242-e20db898832a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-1cee227a-5702-41aa-b8d1-301e8a6752e0 req-e4c56681-fd17-4f47-b795-196a523e4784 tempest-TestStampPattern-1424016276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-e47d38ef-8567-401e-a4c9-cd75570e23b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ceb762d6-af89-49b3-845b-dc5fc88caf61', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:43:35 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-1cee227a-5702-41aa-b8d1-301e8a6752e0 req-e4c56681-fd17-4f47-b795-196a523e4784 tempest-TestStampPattern-1424016276 None] attachment_update completed successfully.
Sep 16 08:43:35 devstack sudo[96481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae
Sep 16 08:43:35 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:35 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae" returned: 0 in 0.435s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:35 devstack sudo[96488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c 1G
Sep 16 08:43:35 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Acquiring lock "cinder-8c56e262-badf-4b06-9de9-39199c8de86b-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-8c56e262-badf-4b06-9de9-39199c8de86b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Acquiring lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Acquiring lock "cinder-quobyte-8c56e262-badf-4b06-9de9-39199c8de86b" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-8c56e262-badf-4b06-9de9-39199c8de86b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Deleting offline snapshot 8c56e262-badf-4b06-9de9-39199c8de86b of volume cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] snapshot_file for this snap is: volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:43:35 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c 1G" returned: 0 in 0.472s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ab34f3-edb7-4caa-92e7-e92ec1c781c3]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:35 devstack sudo[96493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c
Sep 16 08:43:35 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:35 devstack sudo[96494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b
Sep 16 08:43:35 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:36 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c" returned: 0 in 0.361s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:36 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:36 devstack sudo[96502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c
Sep 16 08:43:36 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:36 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b" returned: 0 in 0.480s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c311a78-c9de-4bef-806e-be6bff00a4dc]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:36 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c" returned: 0 in 0.304s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:36 devstack sudo[96510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:36 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:36 devstack sudo[96515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.info
Sep 16 08:43:36 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:36 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.info" returned: 0 in 0.288s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:36 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:36 devstack sudo[96525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.info
Sep 16 08:43:36 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:36 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 0.517s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:36 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b
Sep 16 08:43:36 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:37 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.info" returned: 0 in 0.290s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0e0d10b2-3f4b-4153-b0c7-79391507961e tempest-GroupSnapshotsTest-621664314 None] group_snapshot 95a24123-76fd-4d26-83a9-d7828d87263a: created successfully
Sep 16 08:43:37 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b" returned: 0 in 0.501s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:37 devstack sudo[96535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b
Sep 16 08:43:37 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:37 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.8c56e262-badf-4b06-9de9-39199c8de86b" returned: 0 in 0.257s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-8c56e262-badf-4b06-9de9-39199c8de86b" released by "_delete_snapshot" :: held 1.897s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" released by "delete_snapshot" :: held 1.922s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:37 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Created reservations ['06f112db-3633-4fdb-82f0-293bc54e9507', '8ec79586-94c3-400f-9ea5-cded767b1a64', 'c8279595-5280-4249-9c21-a237b483d40e', 'dcae7056-8ba0-4891-bfce-93efd1059eb9'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:43:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Delete snapshot completed successfully.
Sep 16 08:43:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5623fe1b-12ef-440d-a02f-f671d9ee62d5 tempest-SnapshotsActionsTest-505242917 None] Lock "cinder-8c56e262-badf-4b06-9de9-39199c8de86b-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "cinder-82273c0d-8a8f-4337-b575-ab92821392ea-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Lock "cinder-82273c0d-8a8f-4337-b575-ab92821392ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "cinder-quobyte-82273c0d-8a8f-4337-b575-ab92821392ea" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Lock "cinder-quobyte-82273c0d-8a8f-4337-b575-ab92821392ea" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Deleting offline snapshot 82273c0d-8a8f-4337-b575-ab92821392ea of volume cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] snapshot_file for this snap is: volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bb151d-ebc6-4577-8261-32ffdd8da3e9]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-6746d811-c213-43f9-b0a5-171d2fa5329c-9de09012-55f1-4f20-ae54-8cdf7f645268" by "_create_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:38 devstack sudo[96539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:38 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-6746d811-c213-43f9-b0a5-171d2fa5329c-9de09012-55f1-4f20-ae54-8cdf7f645268" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Creating volume 9de09012-55f1-4f20-ae54-8cdf7f645268 from snapshot 6746d811-c213-43f9-b0a5-171d2fa5329c {{(pid=86261) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-9de09012-55f1-4f20-ae54-8cdf7f645268" by "_copy_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-9de09012-55f1-4f20-ae54-8cdf7f645268" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] snapshot: 6746d811-c213-43f9-b0a5-171d2fa5329c, volume: 9de09012-55f1-4f20-ae54-8cdf7f645268,  {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f38960-2513-4f98-bdbc-e43da1ca6b7e]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:39 devstack sudo[96543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c
Sep 16 08:43:39 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:39 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 0.484s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:39 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[236ed3db-e4e1-4a94-b4a1-9a8feda122d8]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:39 devstack sudo[96555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d
Sep 16 08:43:39 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:39 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c" returned: 0 in 0.511s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:39 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a804b4-f44f-49af-978c-5ed62c71faeb]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:39 devstack sudo[96566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae
Sep 16 08:43:39 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:39 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" returned: 0 in 0.530s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:39 devstack sudo[96571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:39 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:40 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae" returned: 0 in 0.598s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Creating direct copy from snapshot {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG cinder.utils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Path /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268 not found in is_blk_device check {{(pid=86261) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:40 devstack sudo[96612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268
Sep 16 08:43:40 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:40 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 0.606s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:40 devstack sudo[96616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea
Sep 16 08:43:40 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:40 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-f032e2e7-3a62-4282-8e34-fe9bb3327228 req-2e958374-e022-4a3b-9580-1eead4ea441e tempest-TestStampPattern-1424016276 None] Terminate volume connection completed successfully.
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-f032e2e7-3a62-4282-8e34-fe9bb3327228 req-2e958374-e022-4a3b-9580-1eead4ea441e tempest-TestStampPattern-1424016276 None] Deleting attachment ceb762d6-af89-49b3-845b-dc5fc88caf61. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:43:40 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d.82273c0d-8a8f-4337-b575-ab92821392ea" returned: 0 in 0.402s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Lock "cinder-quobyte-82273c0d-8a8f-4337-b575-ab92821392ea" released by "_delete_snapshot" :: held 2.170s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" released by "delete_snapshot" :: held 2.205s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Created reservations ['b83b7c29-48db-48ba-97b3-970012951048', 'b8203269-aa3e-4e67-bdc6-d8e525ecfcd1', '065c3a77-a5b7-42aa-b2e6-61ff867b81b5', '7f6913c3-d19f-47ef-91a8-602425f42aa9'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:43:40 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Delete snapshot completed successfully.
Sep 16 08:43:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8ca1974-1370-4346-9d13-e894533dc032 tempest-SnapshotsActionsTest-1558031737 None] Lock "cinder-82273c0d-8a8f-4337-b575-ab92821392ea-delete_snapshot" released by "delete_snapshot" :: held 2.453s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "cinder-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Lock "cinder-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" acquired by "delete_volume" :: waited 0.040s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:42 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[49626073-e8e0-4641-b0ea-35b37dd5f7b8]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:42 devstack sudo[96633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d
Sep 16 08:43:42 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:42 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" returned: 0 in 0.705s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:43 devstack sudo[96641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d
Sep 16 08:43:43 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:43 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" returned: 0 in 0.471s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Lock "cinder-quobyte-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d" released by "delete_volume" :: held 1.313s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:43 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Created reservations ['a1d9432e-47e0-47af-ac3f-0e38b6e5d441', '292f6b45-86d3-45c4-8ade-3f23d616e5ec', '35861445-2ca7-416e-bfdb-498b4042ad18', 'f1798424-616d-4cbc-9e7f-0353072e5733'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:43:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:43:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:43:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:43 devstack sudo[96649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:43:43 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:44 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.504s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:44 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:43:44 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Deleted volume successfully.
Sep 16 08:43:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-080dbf48-04bf-4b35-9236-b0018af3a258 tempest-SnapshotsActionsTest-1558031737 None] Lock "cinder-cb0997e2-ecf3-4915-9741-a7cc0eb1e18d-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:49 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268" returned: 0 in 9.834s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:49 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae, size 1024.00 MB, duration 9.84 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:43:49 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Converted 1024.00 MB image at 104.11 MB/s
Sep 16 08:43:49 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:43:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:49 devstack sudo[96715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268
Sep 16 08:43:49 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:50 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268" returned: 0 in 0.295s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-9de09012-55f1-4f20-ae54-8cdf7f645268" released by "_copy_volume_from_snapshot" :: held 11.375s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:50 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=83,cinder:UPDATE=67,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:43:50 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=82,cinder:INSERT=16,cinder:UPDATE=76,cinder:DELETE=6 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:43:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-6746d811-c213-43f9-b0a5-171d2fa5329c-9de09012-55f1-4f20-ae54-8cdf7f645268" released by "_create_volume_from_snapshot" :: held 11.469s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.504s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.639s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] Creating offline snapshot 40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 of volume e47d38ef-8567-401e-a4c9-cd75570e23b8 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:43:50 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3098c2cb-9182-4cda-911d-1933bc91d12c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c5340e4f-2b39-4c1a-81cc-af21853488ff tempest-GroupSnapshotsTest-621664314 None] Create group from source-snapshot-95a24123-76fd-4d26-83a9-d7828d87263a completed successfully.
Sep 16 08:43:50 devstack sudo[96718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8
Sep 16 08:43:50 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:50 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8" returned: 0 in 0.447s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:50 devstack sudo[96723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 1G
Sep 16 08:43:50 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:51 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 1G" returned: 0 in 0.471s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:51 devstack sudo[96730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1
Sep 16 08:43:51 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:51 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1" returned: 0 in 0.409s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:51 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 is being set with open permissions: ugo+rw
Sep 16 08:43:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:51 devstack sudo[96735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1
Sep 16 08:43:51 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-9de09012-55f1-4f20-ae54-8cdf7f645268" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-9de09012-55f1-4f20-ae54-8cdf7f645268" acquired by "delete_volume" :: waited 0.034s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:51 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2643a3b3-991b-4bad-b5ed-e2fdd47dee8a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:51 devstack sudo[96737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268
Sep 16 08:43:51 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:51 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1" returned: 0 in 0.350s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:52 devstack sudo[96740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.info
Sep 16 08:43:52 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:52 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268" returned: 0 in 0.427s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:52 devstack sudo[96745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268
Sep 16 08:43:52 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:52 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.info" returned: 0 in 0.357s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:52 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.info is being set with open permissions: ugo+rw
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:52 devstack sudo[96748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.info
Sep 16 08:43:52 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:52 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9de09012-55f1-4f20-ae54-8cdf7f645268" returned: 0 in 0.334s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-9de09012-55f1-4f20-ae54-8cdf7f645268" released by "delete_volume" :: held 0.825s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Created reservations ['79afa6f8-423d-40b8-a3c4-a931147525f1'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:43:52 devstack cinder-volume[86261]: WARNING cinder.quota [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1027584726 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1027584726, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:43:52 devstack cinder-volume[86261]: WARNING cinder.quota [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1027584726 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1027584726, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Created reservations ['b34df383-adfc-4f90-8468-54518f0db767', '4087c5a8-c3d7-436b-80a1-4657d81e3fbe', '186e3ce4-d5d4-426a-bca5-3c24b90ac8e9', 'da550e5b-a6ba-4ef7-a938-0a39fd538456'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:43:52 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.info" returned: 0 in 0.333s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:52 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0fd8431a-38a0-40a8-9f21-bded513e2dd6 tempest-TestStampPattern-1424016276 None] Create snapshot completed successfully
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:52 devstack sudo[96752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:43:52 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:53 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.294s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:53 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:43:53 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b199bd67-3e44-4b13-bfcc-a0936f072692 tempest-GroupSnapshotsTest-621664314 None] Delete group completed successfully.
Sep 16 08:43:54 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] group_snapshot 95a24123-76fd-4d26-83a9-d7828d87263a: deleting
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] group_snapshot 95a24123-76fd-4d26-83a9-d7828d87263a: deleting {{(pid=86261) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-f617b80b-e72a-4eae-bb95-63b2b0c0bcae" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-f617b80b-e72a-4eae-bb95-63b2b0c0bcae" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-6746d811-c213-43f9-b0a5-171d2fa5329c" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-6746d811-c213-43f9-b0a5-171d2fa5329c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Deleting offline snapshot 6746d811-c213-43f9-b0a5-171d2fa5329c of volume f617b80b-e72a-4eae-bb95-63b2b0c0bcae {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] snapshot_file for this snap is: volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0499c1-540f-4175-8b7a-ca003d416ace]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:54 devstack sudo[96761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c
Sep 16 08:43:54 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:54 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c" returned: 0 in 0.613s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4695d0-2b6c-429f-a614-a7536b176439]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:55 devstack sudo[96766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae
Sep 16 08:43:55 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:55 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae" returned: 0 in 0.757s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:55 devstack sudo[96779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c
Sep 16 08:43:55 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:56 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c" returned: 0 in 0.481s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:56 devstack sudo[96796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c
Sep 16 08:43:56 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:56 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae.6746d811-c213-43f9-b0a5-171d2fa5329c" returned: 0 in 0.335s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-6746d811-c213-43f9-b0a5-171d2fa5329c" released by "_delete_snapshot" :: held 2.338s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-f617b80b-e72a-4eae-bb95-63b2b0c0bcae" released by "delete_snapshot" :: held 2.371s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:56 devstack cinder-volume[86261]: WARNING cinder.quota [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1027584726 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1027584726, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:43:56 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] Created reservations ['19ef974d-2174-4d80-bd41-23ae2fc1ab3e', 'bdcacbea-407e-417f-a9a1-fe977850a78b', 'bad1ebdc-325a-40e6-9536-1a140207aed4', 'a6144a64-368b-4e9d-9f79-294541d26cb8'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:43:56 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-609213ca-6dfc-4799-9cb4-8faad6ae62d1 tempest-GroupSnapshotsTest-621664314 None] group_snapshot 95a24123-76fd-4d26-83a9-d7828d87263a: deleted successfully
Sep 16 08:43:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-f617b80b-e72a-4eae-bb95-63b2b0c0bcae" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:43:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-f617b80b-e72a-4eae-bb95-63b2b0c0bcae" acquired by "delete_volume" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:43:58 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a8532e-ca2e-4b61-84b5-098d73386ada]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:43:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:58 devstack sudo[96822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae
Sep 16 08:43:58 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:58 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae" returned: 0 in 0.496s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:58 devstack sudo[96827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae
Sep 16 08:43:58 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:58 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f617b80b-e72a-4eae-bb95-63b2b0c0bcae" returned: 0 in 0.305s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-f617b80b-e72a-4eae-bb95-63b2b0c0bcae" released by "delete_volume" :: held 0.905s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:43:59 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Created reservations ['7ba53b77-bec8-4ba9-8ba0-a7038158226d'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:43:59 devstack cinder-volume[86261]: WARNING cinder.db.api [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1027584726']
Sep 16 08:43:59 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Created reservations ['10a9f4f5-cf11-4d2b-808f-605c93ccebc0', '5c23ea49-1572-4a90-ab7e-56d0c2183717', '4bd05b1d-873d-44d0-974f-9e5cd5062630', 'adaee62b-48c0-424f-802b-419769b66cfc'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:43:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:43:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:43:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:43:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:43:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:43:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:43:59 devstack sudo[96830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:43:59 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:43:59 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root
Sep 16 08:43:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.333s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:43:59 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:43:59 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-69714c90-c29a-4149-90d8-d1e6ab7caff0 tempest-GroupSnapshotsTest-621664314 None] Delete group completed successfully.
Sep 16 08:43:59 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-226622b6-5b26-40dd-8db9-622d235b69ca tempest-GroupSnapshotsTest-621664314 None] Group tempest-GroupSnapshotsTest-Group-44565231: creating
Sep 16 08:43:59 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-226622b6-5b26-40dd-8db9-622d235b69ca tempest-GroupSnapshotsTest-621664314 None] Group tempest-GroupSnapshotsTest-Group-44565231: created successfully
Sep 16 08:43:59 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-226622b6-5b26-40dd-8db9-622d235b69ca tempest-GroupSnapshotsTest-621664314 None] Create group completed successfully.
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Flow 'volume_create_manager' (f630a479-f858-4e92-bfd6-cb6a663d5e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190662ba-cbaf-47f2-9dd4-c3f8f8aefacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190662ba-cbaf-47f2-9dd4-c3f8f8aefacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-489576192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef99b6d2-b80c-4f1f-b26d-e89a67f26e59,host='devstack@QuobyteHD#QuobyteHD',id=427de032-4da2-4bdf-a615-eea0affb8af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b923d0c0e94d2981e44bacca51b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:44:01Z,use_quota=True,user_id='7ceaf93bccb64571b27e1f2f0248d117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a77d236-221e-4b24-bcf8-f83645d38611),volume_type_id=9a77d236-221e-4b24-bcf8-f83645d38611)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdaa0e23-80be-4b35-b4fa-46dac14bdc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdaa0e23-80be-4b35-b4fa-46dac14bdc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4632b336-1ac2-4600-9651-9a4a00dc2854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4632b336-1ac2-4600-9651-9a4a00dc2854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '427de032-4da2-4bdf-a615-eea0affb8af0', 'volume_name': 'volume-427de032-4da2-4bdf-a615-eea0affb8af0', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205f6e9c-0a7f-45b1-a334-031a30595ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205f6e9c-0a7f-45b1-a334-031a30595ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d53bded-b223-436f-b8fe-615310fc47f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:01 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Volume 427de032-4da2-4bdf-a615-eea0affb8af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-427de032-4da2-4bdf-a615-eea0affb8af0', 'volume_size': 1}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ef99b6d2-b80c-4f1f-b26d-e89a67f26e59,created_at=2026-09-16T06:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-489576192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef99b6d2-b80c-4f1f-b26d-e89a67f26e59,host='devstack@QuobyteHD#QuobyteHD',id=427de032-4da2-4bdf-a615-eea0affb8af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b923d0c0e94d2981e44bacca51b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:44:01Z,use_quota=True,user_id='7ceaf93bccb64571b27e1f2f0248d117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a77d236-221e-4b24-bcf8-f83645d38611),volume_type_id=9a77d236-221e-4b24-bcf8-f83645d38611)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Creating volume 427de032-4da2-4bdf-a615-eea0affb8af0 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:44:01 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:01 devstack sudo[96837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0 1073741824
Sep 16 08:44:01 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Flow 'volume_create_manager' (e5c04aa0-1737-47f9-8091-c35bb16643c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc84ffd-2189-4f67-b16f-35b6084721f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc84ffd-2189-4f67-b16f-35b6084721f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1132922100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614287ac-a946-40e9-aa3f-dbdc17223b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b503853278eb449b8283fcf13e460b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=40cdfc33-ee9e-4643-b731-c4f3ee9d48f1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:44:02Z,use_quota=True,user_id='97a403b275d44a64b8fa0721739de65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b3f72a-0b28-4787-b369-7618fb4abe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b3f72a-0b28-4787-b369-7618fb4abe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895f5cc0-e5e9-44cc-8cb4-b61b9e170820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895f5cc0-e5e9-44cc-8cb4-b61b9e170820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '614287ac-a946-40e9-aa3f-dbdc17223b38', 'volume_name': 'volume-614287ac-a946-40e9-aa3f-dbdc17223b38', 'volume_size': 1, 'snapshot_id': '40cdfc33-ee9e-4643-b731-c4f3ee9d48f1'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c89a40-5fce-4456-bb43-f19cf9c79dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c89a40-5fce-4456-bb43-f19cf9c79dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024774a4-0b61-49d0-bf25-f29d9a3c70cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:01 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Volume 614287ac-a946-40e9-aa3f-dbdc17223b38: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-614287ac-a946-40e9-aa3f-dbdc17223b38', 'volume_size': 1, 'snapshot_id': '40cdfc33-ee9e-4643-b731-c4f3ee9d48f1'}
Sep 16 08:44:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:02 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0 1073741824" returned: 0 in 0.560s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:02 devstack sudo[96843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0
Sep 16 08:44:02 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:02 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0" returned: 0 in 0.275s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.629s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Acquiring lock "cinder-quobyte-40cdfc33-ee9e-4643-b731-c4f3ee9d48f1-614287ac-a946-40e9-aa3f-dbdc17223b38" by "_create_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d53bded-b223-436f-b8fe-615310fc47f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-427de032-4da2-4bdf-a615-eea0affb8af0', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e268d1c-e9c9-4b1d-b146-bc8c140af4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Lock "cinder-quobyte-40cdfc33-ee9e-4643-b731-c4f3ee9d48f1-614287ac-a946-40e9-aa3f-dbdc17223b38" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Creating volume 614287ac-a946-40e9-aa3f-dbdc17223b38 from snapshot 40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 {{(pid=86261) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Acquiring lock "cinder-quobyte-614287ac-a946-40e9-aa3f-dbdc17223b38" by "_copy_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:02 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Volume volume-427de032-4da2-4bdf-a615-eea0affb8af0 (427de032-4da2-4bdf-a615-eea0affb8af0): created successfully
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e268d1c-e9c9-4b1d-b146-bc8c140af4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Flow 'volume_create_manager' (f630a479-f858-4e92-bfd6-cb6a663d5e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Lock "cinder-quobyte-614287ac-a946-40e9-aa3f-dbdc17223b38" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] snapshot: 40cdfc33-ee9e-4643-b731-c4f3ee9d48f1, volume: 614287ac-a946-40e9-aa3f-dbdc17223b38,  {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:02 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d280c7e0-a660-4e29-b20a-d6c36c5a90f1 tempest-GroupSnapshotsTest-621664314 None] Created volume successfully.
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3eacd0-4641-4291-b84a-e671a3bb749d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:02 devstack sudo[96849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1
Sep 16 08:44:02 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:03 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1" returned: 0 in 0.534s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e47d38ef-8567-401e-a4c9-cd75570e23b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c881664-56ff-46fa-aa09-d08d63de4cbb]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:03 devstack sudo[96854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8
Sep 16 08:44:03 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Flow 'volume_create_manager' (329914ac-1ca4-41fe-a3ad-4503aa3673d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239323be-7235-4b5f-9d2a-d2ba5d419d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239323be-7235-4b5f-9d2a-d2ba5d419d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1707972597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef99b6d2-b80c-4f1f-b26d-e89a67f26e59,host='devstack@QuobyteHD#QuobyteHD',id=5a065c92-976e-4255-8b1b-c10003831282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b923d0c0e94d2981e44bacca51b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:44:04Z,use_quota=True,user_id='7ceaf93bccb64571b27e1f2f0248d117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a77d236-221e-4b24-bcf8-f83645d38611),volume_type_id=9a77d236-221e-4b24-bcf8-f83645d38611)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3535e8b8-372a-4567-bbfc-e0121cba4ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3535e8b8-372a-4567-bbfc-e0121cba4ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ead3ab9-ce14-4f7d-b155-b52536b037aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ead3ab9-ce14-4f7d-b155-b52536b037aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a065c92-976e-4255-8b1b-c10003831282', 'volume_name': 'volume-5a065c92-976e-4255-8b1b-c10003831282', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b05e5c4-c154-461c-a501-fe3b665493cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b05e5c4-c154-461c-a501-fe3b665493cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e458782-d4cf-4aed-ad37-732644cf4604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:03 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Volume 5a065c92-976e-4255-8b1b-c10003831282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a065c92-976e-4255-8b1b-c10003831282', 'volume_size': 1}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:03 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8" returned: 0 in 0.607s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Creating direct copy from snapshot {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG cinder.utils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Path /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38 not found in is_blk_device check {{(pid=86261) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 08:44:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:03 devstack sudo[96861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38
Sep 16 08:44:03 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:44:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:44:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:44:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:12 devstack sudo[96936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:44:12 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:13 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.750s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:44:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:44:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:44:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:44:13 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=30,cinder:SELECT=39,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:44:13 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=32,cinder:INSERT=7,cinder:UPDATE=40,cinder:DELETE=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:44:14 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38" returned: 0 in 11.118s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:14 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8, size 1024.00 MB, duration 11.12 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:44:14 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Converted 1024.00 MB image at 92.09 MB/s
Sep 16 08:44:14 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38 is being set with open permissions: ugo+rw
Sep 16 08:44:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:15 devstack sudo[96951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38
Sep 16 08:44:15 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:15 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38" returned: 0 in 0.335s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Lock "cinder-quobyte-614287ac-a946-40e9-aa3f-dbdc17223b38" released by "_copy_volume_from_snapshot" :: held 12.741s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Lock "cinder-quobyte-40cdfc33-ee9e-4643-b731-c4f3ee9d48f1-614287ac-a946-40e9-aa3f-dbdc17223b38" released by "_create_volume_from_snapshot" :: held 12.873s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.907s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.696s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ef99b6d2-b80c-4f1f-b26d-e89a67f26e59,created_at=2026-09-16T06:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1707972597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef99b6d2-b80c-4f1f-b26d-e89a67f26e59,host='devstack@QuobyteHD#QuobyteHD',id=5a065c92-976e-4255-8b1b-c10003831282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b923d0c0e94d2981e44bacca51b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:44:04Z,use_quota=True,user_id='7ceaf93bccb64571b27e1f2f0248d117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a77d236-221e-4b24-bcf8-f83645d38611),volume_type_id=9a77d236-221e-4b24-bcf8-f83645d38611)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Creating volume 5a065c92-976e-4255-8b1b-c10003831282 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:44:15 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:15 devstack sudo[96956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282 1073741824
Sep 16 08:44:15 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024774a4-0b61-49d0-bf25-f29d9a3c70cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614287ac-a946-40e9-aa3f-dbdc17223b38', 'volume_size': 1, 'snapshot_id': '40cdfc33-ee9e-4643-b731-c4f3ee9d48f1'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d90e5ad-6b75-4c28-86a4-7160584b8ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:15 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Volume volume-614287ac-a946-40e9-aa3f-dbdc17223b38 (614287ac-a946-40e9-aa3f-dbdc17223b38): created successfully
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d90e5ad-6b75-4c28-86a4-7160584b8ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Flow 'volume_create_manager' (e5c04aa0-1737-47f9-8091-c35bb16643c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:44:15 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e97750bc-a952-41b4-9f90-256481702996 tempest-TestStampPattern-1424016276 None] Created volume successfully.
Sep 16 08:44:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282 1073741824" returned: 0 in 0.828s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:16 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:16 devstack sudo[96963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282
Sep 16 08:44:16 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:16 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282" returned: 0 in 0.334s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:44:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e458782-d4cf-4aed-ad37-732644cf4604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a065c92-976e-4255-8b1b-c10003831282', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c40b7a-1d09-465c-bd66-28c46708a28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:16 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Volume volume-5a065c92-976e-4255-8b1b-c10003831282 (5a065c92-976e-4255-8b1b-c10003831282): created successfully
Sep 16 08:44:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c40b7a-1d09-465c-bd66-28c46708a28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Flow 'volume_create_manager' (329914ac-1ca4-41fe-a3ad-4503aa3673d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:44:16 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-dcd153d7-b7c5-4f02-9c4e-899b353b90c2 tempest-GroupSnapshotsTest-621664314 None] Created volume successfully.
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Flow 'volume_create_manager' (2ed80eb7-4887-43b0-b385-b6b7d52dfc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca19456-5600-49a3-8cdf-b46b31d564c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca19456-5600-49a3-8cdf-b46b31d564c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-718057111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c96e011-851a-4f8f-b75d-dc6d12768244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e4bdc67ebb402a8fdbdb4281f1853d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:44:17Z,use_quota=True,user_id='3f961b45e2344d118c04e5497104b6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dce1657c-aaa9-4794-961b-bd2977204c05),volume_type_id=dce1657c-aaa9-4794-961b-bd2977204c05)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a5b611-9b21-426a-b2de-90559f083c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a5b611-9b21-426a-b2de-90559f083c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efd8c67-0345-4d70-968f-f1789483d47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efd8c67-0345-4d70-968f-f1789483d47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c96e011-851a-4f8f-b75d-dc6d12768244', 'volume_name': 'volume-4c96e011-851a-4f8f-b75d-dc6d12768244', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89337459-a0fa-481b-99d7-4accdf486861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89337459-a0fa-481b-99d7-4accdf486861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ec745f-2778-4844-9806-ea5f39118d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:17 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Volume 4c96e011-851a-4f8f-b75d-dc6d12768244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c96e011-851a-4f8f-b75d-dc6d12768244', 'volume_size': 1}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-718057111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c96e011-851a-4f8f-b75d-dc6d12768244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e4bdc67ebb402a8fdbdb4281f1853d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:44:17Z,use_quota=True,user_id='3f961b45e2344d118c04e5497104b6fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dce1657c-aaa9-4794-961b-bd2977204c05),volume_type_id=dce1657c-aaa9-4794-961b-bd2977204c05)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Creating volume 4c96e011-851a-4f8f-b75d-dc6d12768244 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:44:17 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4c96e011-851a-4f8f-b75d-dc6d12768244 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:17 devstack sudo[96968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4c96e011-851a-4f8f-b75d-dc6d12768244 1073741824
Sep 16 08:44:17 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:17 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-c35d6eec-3055-488b-95bc-fff2c27f919e req-d6b80fa2-9e66-47d6-811e-93f02d48d8f9 tempest-TestMinimumBasicScenario-358967882 None] Terminate volume connection completed successfully.
Sep 16 08:44:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-c35d6eec-3055-488b-95bc-fff2c27f919e req-d6b80fa2-9e66-47d6-811e-93f02d48d8f9 tempest-TestMinimumBasicScenario-358967882 None] Deleting attachment 8fc6c3fc-77bd-4e64-b9c5-e6d473750188. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:44:18 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4c96e011-851a-4f8f-b75d-dc6d12768244 1073741824" returned: 0 in 0.840s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4c96e011-851a-4f8f-b75d-dc6d12768244 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:18 devstack sudo[96977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4c96e011-851a-4f8f-b75d-dc6d12768244
Sep 16 08:44:18 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:18 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9a7b3c45-fd4c-43b8-ae5c-3e30b93256a9 tempest-GroupSnapshotsTest-621664314 None] Update group completed successfully.
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Acquiring lock "cinder-20e38032-58e0-4533-a7d6-745cf261453a-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Lock "cinder-20e38032-58e0-4533-a7d6-745cf261453a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Acquiring lock "cinder-quobyte-20e38032-58e0-4533-a7d6-745cf261453a" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Lock "cinder-quobyte-20e38032-58e0-4533-a7d6-745cf261453a" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bd98b8-4b72-4101-a8ad-95bb0e3ec8f4]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-20e38032-58e0-4533-a7d6-745cf261453a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:18 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4c96e011-851a-4f8f-b75d-dc6d12768244" returned: 0 in 0.381s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ec745f-2778-4844-9806-ea5f39118d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c96e011-851a-4f8f-b75d-dc6d12768244', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88378c0c-6350-4a3e-993c-d2d86ac3dece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:18 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Volume volume-4c96e011-851a-4f8f-b75d-dc6d12768244 (4c96e011-851a-4f8f-b75d-dc6d12768244): created successfully
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88378c0c-6350-4a3e-993c-d2d86ac3dece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Flow 'volume_create_manager' (2ed80eb7-4887-43b0-b385-b6b7d52dfc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:44:18 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-40fa44a5-d19b-419d-a308-7edd454de314 tempest-VolumeTypesAccessTest-2092564731 None] Created volume successfully.
Sep 16 08:44:18 devstack sudo[96980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-20e38032-58e0-4533-a7d6-745cf261453a
Sep 16 08:44:18 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:19 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-20e38032-58e0-4533-a7d6-745cf261453a" returned: 0 in 0.418s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-20e38032-58e0-4533-a7d6-745cf261453a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:19 devstack sudo[96985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-20e38032-58e0-4533-a7d6-745cf261453a
Sep 16 08:44:19 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Acquiring lock "cinder-4c96e011-851a-4f8f-b75d-dc6d12768244-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Lock "cinder-4c96e011-851a-4f8f-b75d-dc6d12768244-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Acquiring lock "cinder-quobyte-4c96e011-851a-4f8f-b75d-dc6d12768244" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Lock "cinder-quobyte-4c96e011-851a-4f8f-b75d-dc6d12768244" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[559e644b-7333-4b57-8b91-52afb9d197fe]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4c96e011-851a-4f8f-b75d-dc6d12768244 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:19 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-20e38032-58e0-4533-a7d6-745cf261453a" returned: 0 in 0.377s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Lock "cinder-quobyte-20e38032-58e0-4533-a7d6-745cf261453a" released by "delete_volume" :: held 0.867s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Created reservations ['82f7d013-1038-4c48-9a76-24b967e7949b', '94e91ca5-eba0-45a4-b1cf-21b9d30c473c', 'c3ee33dc-172b-45b5-839e-bfd1e25d2be7', '73593f71-53e7-4da2-a331-d2fc9ebced1b'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:44:19 devstack sudo[96988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4c96e011-851a-4f8f-b75d-dc6d12768244
Sep 16 08:44:19 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:19 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d8682725-3e00-450b-b16e-befa954d321f tempest-GroupSnapshotsTest-621664314 None] Update group completed successfully.
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:19 devstack sudo[96991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:44:19 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:20 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4c96e011-851a-4f8f-b75d-dc6d12768244" returned: 0 in 0.592s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4c96e011-851a-4f8f-b75d-dc6d12768244 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:20 devstack sudo[96996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4c96e011-851a-4f8f-b75d-dc6d12768244
Sep 16 08:44:20 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:20 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.337s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:44:20 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Deleted volume successfully.
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2ab1e503-63e1-477a-a894-f206f32cc481 tempest-TestMinimumBasicScenario-358967882 None] Lock "cinder-20e38032-58e0-4533-a7d6-745cf261453a-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:20 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4c96e011-851a-4f8f-b75d-dc6d12768244" returned: 0 in 0.300s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Lock "cinder-quobyte-4c96e011-851a-4f8f-b75d-dc6d12768244" released by "delete_volume" :: held 0.959s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:20 devstack cinder-volume[86261]: WARNING cinder.quota [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1955507925 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1955507925, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:44:20 devstack cinder-volume[86261]: WARNING cinder.quota [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1955507925 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1955507925, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Created reservations ['03c486a7-2c61-4768-a6ff-16f24c51f2f5', '0d58cd15-2881-4f0b-b8e6-63511c1e0150', 'b04af745-16c6-4f24-afd6-3e81842c9296', 'b529e1ab-5bfc-4f9e-824b-d88d1f2b5f1d'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:20 devstack sudo[97001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:44:20 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:21 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.410s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:21 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:44:21 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Deleted volume successfully.
Sep 16 08:44:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-df441c0a-dbcf-445a-857e-5e9f8d593034 tempest-VolumeTypesAccessTest-2092564731 None] Lock "cinder-4c96e011-851a-4f8f-b75d-dc6d12768244-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:21 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5776d238-b501-4def-9ce4-f8d427b8fbe3 tempest-GroupSnapshotsTest-621664314 None] Update group completed successfully.
Sep 16 08:44:22 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-16fad9a8-768a-4b25-bbed-9a5152f73e09 tempest-GroupSnapshotsTest-621664314 None] Update group completed successfully.
Sep 16 08:44:24 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] GroupSnapshot 8e4096d0-bae2-4171-abbc-a261bfb30f4b: creating.
Sep 16 08:44:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Group snapshot 8e4096d0-bae2-4171-abbc-a261bfb30f4b: creating. {{(pid=86261) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 16 08:44:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Creating offline snapshot 088a2a24-3549-499b-bb6e-7d584ead4b80 of volume 5a065c92-976e-4255-8b1b-c10003831282 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:44:24 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52815dc-8387-484a-8020-d6c3c03f3798]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:24 devstack sudo[97029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282
Sep 16 08:44:24 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:24 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282" returned: 0 in 0.537s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:24 devstack sudo[97034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80 1G
Sep 16 08:44:24 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:25 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80 1G" returned: 0 in 0.594s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a065c92-976e-4255-8b1b-c10003831282 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:25 devstack sudo[97040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a065c92-976e-4255-8b1b-c10003831282 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80
Sep 16 08:44:25 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:25 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a065c92-976e-4255-8b1b-c10003831282 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80" returned: 0 in 0.474s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:25 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:44:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:25 devstack sudo[97045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80
Sep 16 08:44:25 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:26 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80" returned: 0 in 0.337s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:26 devstack sudo[97048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.info
Sep 16 08:44:26 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:26 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.info" returned: 0 in 0.447s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:26 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:44:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:26 devstack sudo[97052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.info
Sep 16 08:44:26 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:26 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.info" returned: 0 in 0.320s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.854s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Creating offline snapshot 959bf284-5c16-4b57-a8e8-bd08678e8b43 of volume 427de032-4da2-4bdf-a615-eea0affb8af0 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:44:27 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aed1a9c-5363-4bb1-9aad-e496b805f1bd]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:27 devstack sudo[97055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0
Sep 16 08:44:27 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:27 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0" returned: 0 in 0.501s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:27 devstack sudo[97061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43 1G
Sep 16 08:44:27 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:28 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43 1G" returned: 0 in 0.616s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-427de032-4da2-4bdf-a615-eea0affb8af0 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:28 devstack sudo[97088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-427de032-4da2-4bdf-a615-eea0affb8af0 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43
Sep 16 08:44:28 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:28 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-427de032-4da2-4bdf-a615-eea0affb8af0 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43" returned: 0 in 0.350s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:28 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:44:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:28 devstack sudo[97093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43
Sep 16 08:44:28 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:28 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43" returned: 0 in 0.240s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:28 devstack sudo[97096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.info
Sep 16 08:44:28 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:29 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.info" returned: 0 in 0.279s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:29 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:44:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:29 devstack sudo[97099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.info
Sep 16 08:44:29 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:29 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.info" returned: 0 in 0.323s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.434s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:29 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4d51df9f-4a03-4c58-87cc-0592beb0b015 tempest-GroupSnapshotsTest-621664314 None] group_snapshot 8e4096d0-bae2-4171-abbc-a261bfb30f4b: created successfully
Sep 16 08:44:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] group_snapshot 8e4096d0-bae2-4171-abbc-a261bfb30f4b: deleting
Sep 16 08:44:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] group_snapshot 8e4096d0-bae2-4171-abbc-a261bfb30f4b: deleting {{(pid=86261) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 16 08:44:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-5a065c92-976e-4255-8b1b-c10003831282" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-5a065c92-976e-4255-8b1b-c10003831282" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-088a2a24-3549-499b-bb6e-7d584ead4b80" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-088a2a24-3549-499b-bb6e-7d584ead4b80" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Deleting offline snapshot 088a2a24-3549-499b-bb6e-7d584ead4b80 of volume 5a065c92-976e-4255-8b1b-c10003831282 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:44:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] snapshot_file for this snap is: volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:44:30 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[692a10b2-ae5e-4cc1-88ec-2f4abe5e5e27]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:31 devstack sudo[97103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80
Sep 16 08:44:31 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:31 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80" returned: 0 in 0.488s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a065c92-976e-4255-8b1b-c10003831282(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:44:31 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6584cc4-39d4-466d-895b-46b3f978e34a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:31 devstack sudo[97109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282
Sep 16 08:44:31 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:31 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282" returned: 0 in 0.459s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:31 devstack sudo[97116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80
Sep 16 08:44:31 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:32 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80" returned: 0 in 0.378s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:32 devstack sudo[97121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80
Sep 16 08:44:32 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:32 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282.088a2a24-3549-499b-bb6e-7d584ead4b80" returned: 0 in 0.276s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-088a2a24-3549-499b-bb6e-7d584ead4b80" released by "_delete_snapshot" :: held 1.735s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-5a065c92-976e-4255-8b1b-c10003831282" released by "delete_snapshot" :: held 1.771s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-427de032-4da2-4bdf-a615-eea0affb8af0" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-427de032-4da2-4bdf-a615-eea0affb8af0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-959bf284-5c16-4b57-a8e8-bd08678e8b43" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-959bf284-5c16-4b57-a8e8-bd08678e8b43" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Deleting offline snapshot 959bf284-5c16-4b57-a8e8-bd08678e8b43 of volume 427de032-4da2-4bdf-a615-eea0affb8af0 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] snapshot_file for this snap is: volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d7379f-223e-4d6d-9484-9d64fc03df72]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:32 devstack sudo[97124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43
Sep 16 08:44:32 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:33 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43" returned: 0 in 0.394s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-427de032-4da2-4bdf-a615-eea0affb8af0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:44:33 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb14b07b-80f9-48cb-8b1d-1dda7d7e8bf0]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:33 devstack sudo[97130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0
Sep 16 08:44:33 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:33 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0" returned: 0 in 0.436s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:33 devstack sudo[97135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43
Sep 16 08:44:33 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:33 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43" returned: 0 in 0.394s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:33 devstack sudo[97140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43
Sep 16 08:44:33 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:34 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0.959bf284-5c16-4b57-a8e8-bd08678e8b43" returned: 0 in 0.284s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-959bf284-5c16-4b57-a8e8-bd08678e8b43" released by "_delete_snapshot" :: held 1.644s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-427de032-4da2-4bdf-a615-eea0affb8af0" released by "delete_snapshot" :: held 1.667s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:34 devstack cinder-volume[86261]: WARNING cinder.quota [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1474741706 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1474741706, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:44:34 devstack cinder-volume[86261]: WARNING cinder.quota [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1474741706 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1474741706, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:44:34 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Created reservations ['45c93fc1-e919-41e3-a7bd-9a5cefc909cc', '673b0570-41af-486d-a76f-edf432b7e090', '056c6fe1-8e0e-4dd0-8f11-9f5aad35c1da', 'd4ed7a7c-c7fa-4975-961a-51714acd9ba4'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:44:34 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] Created reservations ['9266f22d-e4b4-4a25-a7f7-3ef28022d792', '0432701c-56bc-40aa-93f0-1e3279c65c3a', '17ec44ac-b26f-4369-947f-137cfadb4b2a', '7a4bdf99-e0ea-40dd-8dc5-eecb30090eaa'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:44:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4d7c70ad-ce35-4cdd-880b-080b1c51d6ae tempest-GroupSnapshotsTest-621664314 None] group_snapshot 8e4096d0-bae2-4171-abbc-a261bfb30f4b: deleted successfully
Sep 16 08:44:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-427de032-4da2-4bdf-a615-eea0affb8af0" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-427de032-4da2-4bdf-a615-eea0affb8af0" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:35 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58337a0-6e65-4997-af25-0413b162333f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:35 devstack sudo[97144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0
Sep 16 08:44:35 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:36 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0" returned: 0 in 0.431s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:36 devstack sudo[97149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0
Sep 16 08:44:36 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:36 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-427de032-4da2-4bdf-a615-eea0affb8af0" returned: 0 in 0.277s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-427de032-4da2-4bdf-a615-eea0affb8af0" released by "delete_volume" :: held 0.803s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-5a065c92-976e-4255-8b1b-c10003831282" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-5a065c92-976e-4255-8b1b-c10003831282" acquired by "delete_volume" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:36 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff86b07-90c5-437b-b45e-9d869696d2f2]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:36 devstack sudo[97152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282
Sep 16 08:44:36 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:37 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282" returned: 0 in 0.486s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:37 devstack sudo[97158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282
Sep 16 08:44:37 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:37 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5a065c92-976e-4255-8b1b-c10003831282" returned: 0 in 0.275s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-5a065c92-976e-4255-8b1b-c10003831282" released by "delete_volume" :: held 0.867s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Created reservations ['01efad1b-50d5-4f1c-b5fa-8bb8f39b4638'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:44:37 devstack cinder-volume[86261]: WARNING cinder.quota [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1474741706 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1474741706, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Created reservations ['6edb4bf4-b777-4792-96fb-8a3f731bd5c0', '5cbc66b1-fea9-419a-9450-11ee7c2e97d2', 'd9c78786-1482-4844-9689-b9ee870324c2', 'bd0ac1c7-bb05-421b-a620-6e0c0d031229'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Created reservations ['ef8867dc-eec3-4526-a5f7-ebce950c7d27', 'b53be1c1-8b27-4d49-965a-259c931bbe8e', 'fef1553a-f648-428c-bdc6-9919ec7d119f', '3b4dd16d-8411-455d-8b7d-79fed159faea'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:37 devstack sudo[97161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:44:37 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:38 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.280s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:38 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:44:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-25fe8551-2a9f-4264-a4c8-d7ebe2cf882e tempest-GroupSnapshotsTest-621664314 None] Delete group completed successfully.
Sep 16 08:44:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-67059b30-786e-4624-be28-246cf4aeb516 tempest-GroupSnapshotsTest-621664314 None] Group tempest-GroupSnapshotsTest-Group-1736104276: creating
Sep 16 08:44:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-67059b30-786e-4624-be28-246cf4aeb516 tempest-GroupSnapshotsTest-621664314 None] Group tempest-GroupSnapshotsTest-Group-1736104276: created successfully
Sep 16 08:44:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-67059b30-786e-4624-be28-246cf4aeb516 tempest-GroupSnapshotsTest-621664314 None] Create group completed successfully.
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Flow 'volume_create_manager' (9e839a98-74ab-43a8-a8dc-94f0eefe8c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d69ef4-c21e-4601-8480-110cffff2bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d69ef4-c21e-4601-8480-110cffff2bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-338852074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e327e044-7aff-4d69-892c-ca95bb578aee,host='devstack@QuobyteHD#QuobyteHD',id=f5b08a93-f613-413b-a326-937b2c2466b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b923d0c0e94d2981e44bacca51b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:44:41Z,use_quota=True,user_id='7ceaf93bccb64571b27e1f2f0248d117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f4f92c0-8eaf-4161-b671-1d9b0157abf0),volume_type_id=5f4f92c0-8eaf-4161-b671-1d9b0157abf0)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b7573b-7512-4741-b1c2-a81af79c9223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b7573b-7512-4741-b1c2-a81af79c9223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fe9ed2-d70e-42c9-9bb7-89681c63882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fe9ed2-d70e-42c9-9bb7-89681c63882c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b08a93-f613-413b-a326-937b2c2466b5', 'volume_name': 'volume-f5b08a93-f613-413b-a326-937b2c2466b5', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded2dcd3-19a7-4725-9127-52a43f852ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded2dcd3-19a7-4725-9127-52a43f852ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfe28a8-9017-4e61-b88a-7e16036128f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:40 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Volume f5b08a93-f613-413b-a326-937b2c2466b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b08a93-f613-413b-a326-937b2c2466b5', 'volume_size': 1}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e327e044-7aff-4d69-892c-ca95bb578aee,created_at=2026-09-16T06:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-338852074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e327e044-7aff-4d69-892c-ca95bb578aee,host='devstack@QuobyteHD#QuobyteHD',id=f5b08a93-f613-413b-a326-937b2c2466b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b923d0c0e94d2981e44bacca51b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:44:41Z,use_quota=True,user_id='7ceaf93bccb64571b27e1f2f0248d117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f4f92c0-8eaf-4161-b671-1d9b0157abf0),volume_type_id=5f4f92c0-8eaf-4161-b671-1d9b0157abf0)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Creating volume f5b08a93-f613-413b-a326-937b2c2466b5 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:44:40 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:44:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:40 devstack sudo[97206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5 1073741824
Sep 16 08:44:40 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:41 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5 1073741824" returned: 0 in 0.798s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:41 devstack sudo[97223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5
Sep 16 08:44:41 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-baa6a510-38e2-4d99-b7f6-7aa98651f1c8 req-5d55bb42-791c-4e4a-95de-750dd3d69865 tempest-TestStampPattern-1424016276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:41 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5" returned: 0 in 0.325s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:44:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-baa6a510-38e2-4d99-b7f6-7aa98651f1c8 req-5d55bb42-791c-4e4a-95de-750dd3d69865 tempest-TestStampPattern-1424016276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.135s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfe28a8-9017-4e61-b88a-7e16036128f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b08a93-f613-413b-a326-937b2c2466b5', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09d7130-bef0-4164-ae27-3577933da6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:44:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-baa6a510-38e2-4d99-b7f6-7aa98651f1c8 req-5d55bb42-791c-4e4a-95de-750dd3d69865 tempest-TestStampPattern-1424016276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:42 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Volume volume-f5b08a93-f613-413b-a326-937b2c2466b5 (f5b08a93-f613-413b-a326-937b2c2466b5): created successfully
Sep 16 08:44:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09d7130-bef0-4164-ae27-3577933da6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:44:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Flow 'volume_create_manager' (9e839a98-74ab-43a8-a8dc-94f0eefe8c1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:44:42 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a8ee4126-fbce-4469-99a7-fc51419b8080 tempest-GroupSnapshotsTest-621664314 None] Created volume successfully.
Sep 16 08:44:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-baa6a510-38e2-4d99-b7f6-7aa98651f1c8 req-5d55bb42-791c-4e4a-95de-750dd3d69865 tempest-TestStampPattern-1424016276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-614287ac-a946-40e9-aa3f-dbdc17223b38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8546805a-9900-4f91-9c4e-84b2bd0a00c0', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:44:42 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-baa6a510-38e2-4d99-b7f6-7aa98651f1c8 req-5d55bb42-791c-4e4a-95de-750dd3d69865 tempest-TestStampPattern-1424016276 None] attachment_update completed successfully.
Sep 16 08:44:43 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] GroupSnapshot 6bc1f4d5-38eb-4277-9792-1061296faf0a: creating.
Sep 16 08:44:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] Group snapshot 6bc1f4d5-38eb-4277-9792-1061296faf0a: creating. {{(pid=86261) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 16 08:44:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] Creating offline snapshot 0104f5bc-4f5a-4b18-a819-d9e957d6f0af of volume f5b08a93-f613-413b-a326-937b2c2466b5 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:44:43 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23aae97-d4a6-4dce-bbe0-dd98b88a01bf]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:43 devstack sudo[97638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5
Sep 16 08:44:43 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:44 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5" returned: 0 in 0.589s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:44 devstack sudo[97655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af 1G
Sep 16 08:44:44 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:44 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af 1G" returned: 0 in 0.519s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5b08a93-f613-413b-a326-937b2c2466b5 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:44 devstack sudo[97667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5b08a93-f613-413b-a326-937b2c2466b5 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af
Sep 16 08:44:44 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:45 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5b08a93-f613-413b-a326-937b2c2466b5 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af" returned: 0 in 0.425s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:45 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:44:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:45 devstack sudo[97673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af
Sep 16 08:44:45 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:45 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-ae78c10a-e5ff-410b-b1c6-8cce84f53b73 req-81bd5c36-ae17-4d14-ac6f-cf101e5c7b8e tempest-TestStampPattern-1424016276 None] Terminate volume connection completed successfully.
Sep 16 08:44:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-ae78c10a-e5ff-410b-b1c6-8cce84f53b73 req-81bd5c36-ae17-4d14-ac6f-cf101e5c7b8e tempest-TestStampPattern-1424016276 None] Deleting attachment 8546805a-9900-4f91-9c4e-84b2bd0a00c0. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:44:45 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af" returned: 0 in 0.415s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:45 devstack sudo[97703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.info
Sep 16 08:44:45 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:45 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.info" returned: 0 in 0.305s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:45 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 08:44:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:45 devstack sudo[97706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.info
Sep 16 08:44:45 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:46 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.info" returned: 0 in 0.271s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.657s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:46 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-6ed26cee-4604-4509-bbb1-83a22f86a3e6 tempest-GroupSnapshotsTest-621664314 None] group_snapshot 6bc1f4d5-38eb-4277-9792-1061296faf0a: created successfully
Sep 16 08:44:47 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] group_snapshot 6bc1f4d5-38eb-4277-9792-1061296faf0a: deleting
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] group_snapshot 6bc1f4d5-38eb-4277-9792-1061296faf0a: deleting {{(pid=86261) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-f5b08a93-f613-413b-a326-937b2c2466b5" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-f5b08a93-f613-413b-a326-937b2c2466b5" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-0104f5bc-4f5a-4b18-a819-d9e957d6f0af" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-0104f5bc-4f5a-4b18-a819-d9e957d6f0af" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Deleting offline snapshot 0104f5bc-4f5a-4b18-a819-d9e957d6f0af of volume f5b08a93-f613-413b-a326-937b2c2466b5 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] snapshot_file for this snap is: volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c22bf8-5c24-417a-8094-5e492bb65780]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:47 devstack sudo[97722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af
Sep 16 08:44:47 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:47 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af" returned: 0 in 0.468s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5b08a93-f613-413b-a326-937b2c2466b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4bff69-14ff-43ec-9e21-4ec793d19c48]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:47 devstack sudo[97731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5
Sep 16 08:44:47 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:48 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5" returned: 0 in 0.510s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:48 devstack sudo[97736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af
Sep 16 08:44:48 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:48 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af" returned: 0 in 0.444s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:48 devstack sudo[97742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af
Sep 16 08:44:48 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:49 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5.0104f5bc-4f5a-4b18-a819-d9e957d6f0af" returned: 0 in 0.377s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-0104f5bc-4f5a-4b18-a819-d9e957d6f0af" released by "_delete_snapshot" :: held 1.999s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-f5b08a93-f613-413b-a326-937b2c2466b5" released by "delete_snapshot" :: held 2.055s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:49 devstack cinder-volume[86261]: WARNING cinder.quota [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2114754507 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2114754507, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:44:49 devstack cinder-volume[86261]: WARNING cinder.quota [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2114754507 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2114754507, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:44:49 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] Created reservations ['c3c72988-89fb-45f8-b7ff-c8dbdb7b4595', 'bae83f44-5eca-46e9-87df-36ab3372a64e', 'f885ed51-d2ab-40f7-9d6a-c0f1cdc566d8', '02b9058f-b105-4721-b760-08603b954115'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:44:49 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-09840ce8-9f16-4c51-8912-641c5cf96392 tempest-GroupSnapshotsTest-621664314 None] group_snapshot 6bc1f4d5-38eb-4277-9792-1061296faf0a: deleted successfully
Sep 16 08:44:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "cinder-quobyte-f5b08a93-f613-413b-a326-937b2c2466b5" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-f5b08a93-f613-413b-a326-937b2c2466b5" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:51 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e23b8bf-960d-4a70-85ca-37fc369455dd]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:51 devstack sudo[97769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5
Sep 16 08:44:51 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:51 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5" returned: 0 in 0.459s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:51 devstack sudo[97776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5
Sep 16 08:44:51 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:51 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f5b08a93-f613-413b-a326-937b2c2466b5" returned: 0 in 0.298s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Lock "cinder-quobyte-f5b08a93-f613-413b-a326-937b2c2466b5" released by "delete_volume" :: held 0.890s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:51 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Created reservations ['7e3cb744-c6d7-42bd-be71-cd4dac1b7ac7'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:44:51 devstack cinder-volume[86261]: WARNING cinder.quota [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2114754507 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2114754507, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:44:52 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Created reservations ['a5ddabc0-3f88-4e24-9b4c-cae5ae2168eb', '7aa4f105-cc7d-460e-8212-4b7733b273c6', '1428aa2e-7e4e-4a9a-bdc0-25f973a553a9', '628c4642-c214-4d94-a8f7-5949f394a9e6'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:44:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:44:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:44:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:52 devstack sudo[97779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:44:52 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:52 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.445s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:52 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:44:52 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7a3686f2-9161-4b8f-8c2f-8c7fb888b889 tempest-GroupSnapshotsTest-621664314 None] Delete group completed successfully.
Sep 16 08:44:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Acquiring lock "cinder-614287ac-a946-40e9-aa3f-dbdc17223b38-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Lock "cinder-614287ac-a946-40e9-aa3f-dbdc17223b38-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Acquiring lock "cinder-quobyte-614287ac-a946-40e9-aa3f-dbdc17223b38" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Lock "cinder-quobyte-614287ac-a946-40e9-aa3f-dbdc17223b38" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:58 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[042ec836-d057-4a79-9bce-5401ca2cca78]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:44:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:58 devstack sudo[97792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38
Sep 16 08:44:58 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:58 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38" returned: 0 in 0.409s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:58 devstack sudo[97798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38
Sep 16 08:44:58 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:59 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-614287ac-a946-40e9-aa3f-dbdc17223b38" returned: 0 in 0.276s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Lock "cinder-quobyte-614287ac-a946-40e9-aa3f-dbdc17223b38" released by "delete_volume" :: held 0.748s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Created reservations ['22eeaaff-2afb-4c7a-a8c2-dc08f72cf5ea', '548736c8-fa57-4435-bd94-02b2e141f260', 'fe751ebd-9abb-482c-8bdc-bdc1321c0f1f', 'a0a1d1bc-24e2-4a52-b3d7-2be3a1311155'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:44:59 devstack sudo[97801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:44:59 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:44:59 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.431s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:44:59 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Deleted volume successfully.
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c42247ea-2f0c-4bb2-abfb-89334451ad00 tempest-TestStampPattern-1424016276 None] Lock "cinder-614287ac-a946-40e9-aa3f-dbdc17223b38-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Acquiring lock "cinder-40cdfc33-ee9e-4643-b731-c4f3ee9d48f1-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Lock "cinder-40cdfc33-ee9e-4643-b731-c4f3ee9d48f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Acquiring lock "cinder-quobyte-e47d38ef-8567-401e-a4c9-cd75570e23b8" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Lock "cinder-quobyte-e47d38ef-8567-401e-a4c9-cd75570e23b8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Acquiring lock "cinder-quobyte-40cdfc33-ee9e-4643-b731-c4f3ee9d48f1" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Lock "cinder-quobyte-40cdfc33-ee9e-4643-b731-c4f3ee9d48f1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:44:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Deleting offline snapshot 40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 of volume e47d38ef-8567-401e-a4c9-cd75570e23b8 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:45:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] snapshot_file for this snap is: volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:45:00 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aab8b4-a09c-47e2-baf0-77985e2b92ca]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:00 devstack sudo[97804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1
Sep 16 08:45:00 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:00 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1" returned: 0 in 0.441s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e47d38ef-8567-401e-a4c9-cd75570e23b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:45:00 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0534ba14-f8a8-4336-a537-fa9dae6fd117]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:00 devstack sudo[97809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8
Sep 16 08:45:00 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:01 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8" returned: 0 in 0.633s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:01 devstack sudo[97814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1
Sep 16 08:45:01 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:01 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1" returned: 0 in 0.421s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:01 devstack sudo[97824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1
Sep 16 08:45:01 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:01 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8.40cdfc33-ee9e-4643-b731-c4f3ee9d48f1" returned: 0 in 0.278s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Lock "cinder-quobyte-40cdfc33-ee9e-4643-b731-c4f3ee9d48f1" released by "_delete_snapshot" :: held 1.946s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Lock "cinder-quobyte-e47d38ef-8567-401e-a4c9-cd75570e23b8" released by "delete_snapshot" :: held 1.979s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:02 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Created reservations ['8e759277-b713-41cc-a87a-9a5c25b382e9', '3e2d91bb-cad4-4f84-981a-e96fea7e7c05', '06ba90fa-75f4-4c1a-9d1e-d9c9a3d31512', 'b28bdba4-fe0c-4a3e-aa73-2f768592441d'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:02 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Delete snapshot completed successfully.
Sep 16 08:45:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-860ee486-439c-4bfe-803f-04aaa75f9a09 tempest-TestStampPattern-1424016276 None] Lock "cinder-40cdfc33-ee9e-4643-b731-c4f3ee9d48f1-delete_snapshot" released by "delete_snapshot" :: held 2.270s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:07 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8a62dabc-1db5-4d63-82f8-16b57a54f101 tempest-GroupsTest-170149294 None] Group tempest-Group1-563746460: creating
Sep 16 08:45:07 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8a62dabc-1db5-4d63-82f8-16b57a54f101 tempest-GroupsTest-170149294 None] Group tempest-Group1-563746460: created successfully
Sep 16 08:45:07 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8a62dabc-1db5-4d63-82f8-16b57a54f101 tempest-GroupsTest-170149294 None] Create group completed successfully.
Sep 16 08:45:08 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9de1e0fc-584e-4530-bb55-ff47fd3d657b tempest-GroupsTest-170149294 None] Group tempest-Group2-1491932022: creating
Sep 16 08:45:08 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9de1e0fc-584e-4530-bb55-ff47fd3d657b tempest-GroupsTest-170149294 None] Group tempest-Group2-1491932022: created successfully
Sep 16 08:45:08 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9de1e0fc-584e-4530-bb55-ff47fd3d657b tempest-GroupsTest-170149294 None] Create group completed successfully.
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Flow 'volume_create_manager' (35025cc0-3d33-47a8-ba8d-2d90ec68f47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62876b67-5118-449a-b18f-2075725f01bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Acquiring lock "cinder-e47d38ef-8567-401e-a4c9-cd75570e23b8-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62876b67-5118-449a-b18f-2075725f01bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137821292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=14003622-662c-4c9e-8fd5-7033f7d40188,host='devstack@QuobyteHD#QuobyteHD',id=6963fa13-fede-4791-8dbf-ca2973f57991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596eb16aa9c47069278fe2ce61bb61a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:10Z,use_quota=True,user_id='f7f45504a7a5486bae9fc156582c5886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fbd4e23-1c19-4302-989c-dc92980a0232),volume_type_id=7fbd4e23-1c19-4302-989c-dc92980a0232)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a766bf6-9c03-41f2-870f-23d68976dd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a766bf6-9c03-41f2-870f-23d68976dd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a17685-510f-455c-b00e-37cef14f13f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a17685-510f-455c-b00e-37cef14f13f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6963fa13-fede-4791-8dbf-ca2973f57991', 'volume_name': 'volume-6963fa13-fede-4791-8dbf-ca2973f57991', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b7c30d-4d0e-4bfe-824e-83f01ad14d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b7c30d-4d0e-4bfe-824e-83f01ad14d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475bba88-73c7-4dd2-855f-84a9b02227f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:10 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Volume 6963fa13-fede-4791-8dbf-ca2973f57991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6963fa13-fede-4791-8dbf-ca2973f57991', 'volume_size': 1}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=14003622-662c-4c9e-8fd5-7033f7d40188,created_at=2026-09-16T06:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137821292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=14003622-662c-4c9e-8fd5-7033f7d40188,host='devstack@QuobyteHD#QuobyteHD',id=6963fa13-fede-4791-8dbf-ca2973f57991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596eb16aa9c47069278fe2ce61bb61a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:10Z,use_quota=True,user_id='f7f45504a7a5486bae9fc156582c5886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fbd4e23-1c19-4302-989c-dc92980a0232),volume_type_id=7fbd4e23-1c19-4302-989c-dc92980a0232)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Creating volume 6963fa13-fede-4791-8dbf-ca2973f57991 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:45:10 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6963fa13-fede-4791-8dbf-ca2973f57991 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:10 devstack sudo[97856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6963fa13-fede-4791-8dbf-ca2973f57991 1073741824
Sep 16 08:45:10 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Lock "cinder-e47d38ef-8567-401e-a4c9-cd75570e23b8-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Acquiring lock "cinder-quobyte-e47d38ef-8567-401e-a4c9-cd75570e23b8" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Lock "cinder-quobyte-e47d38ef-8567-401e-a4c9-cd75570e23b8" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[381d159d-7af2-4807-9567-fe31a5d624df]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:10 devstack sudo[97858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8
Sep 16 08:45:10 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:11 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6963fa13-fede-4791-8dbf-ca2973f57991 1073741824" returned: 0 in 0.581s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6963fa13-fede-4791-8dbf-ca2973f57991 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:11 devstack sudo[97865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6963fa13-fede-4791-8dbf-ca2973f57991
Sep 16 08:45:11 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:11 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8" returned: 0 in 0.545s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:11 devstack sudo[97870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8
Sep 16 08:45:11 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:11 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6963fa13-fede-4791-8dbf-ca2973f57991" returned: 0 in 0.277s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475bba88-73c7-4dd2-855f-84a9b02227f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6963fa13-fede-4791-8dbf-ca2973f57991', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4084169b-106e-4b9c-8cc3-3af5169c2de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:11 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Volume volume-6963fa13-fede-4791-8dbf-ca2973f57991 (6963fa13-fede-4791-8dbf-ca2973f57991): created successfully
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4084169b-106e-4b9c-8cc3-3af5169c2de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Flow 'volume_create_manager' (35025cc0-3d33-47a8-ba8d-2d90ec68f47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:11 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3aacbf81-2e61-4666-af48-9150c5a4408d tempest-GroupsTest-170149294 None] Created volume successfully.
Sep 16 08:45:11 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e47d38ef-8567-401e-a4c9-cd75570e23b8" returned: 0 in 0.325s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Lock "cinder-quobyte-e47d38ef-8567-401e-a4c9-cd75570e23b8" released by "delete_volume" :: held 0.976s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Created reservations ['99da34a3-8929-4434-8a0d-27a1f266f4a2', 'a04fc790-bc7c-4485-b536-4ec4b8b221bc', 'e4416f87-4646-4b48-a067-a44680c32925', '7b8f74b5-4c55-4972-a826-5751c3c88987'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:11 devstack sudo[97877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:11 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:12 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.304s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:45:12 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Deleted volume successfully.
Sep 16 08:45:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2ed4e68c-a368-4bdc-a0f9-8d89ca226a9c tempest-TestStampPattern-1424016276 None] Lock "cinder-e47d38ef-8567-401e-a4c9-cd75570e23b8-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:45:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:12 devstack sudo[97880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:12 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Acquiring lock "cinder-quobyte-6963fa13-fede-4791-8dbf-ca2973f57991" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Lock "cinder-quobyte-6963fa13-fede-4791-8dbf-ca2973f57991" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:13 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.415s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:45:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:45:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:45:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:45:13 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[057cb1f1-026a-4585-973c-012394db2e57]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6963fa13-fede-4791-8dbf-ca2973f57991 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:13 devstack sudo[97883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6963fa13-fede-4791-8dbf-ca2973f57991
Sep 16 08:45:13 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:13 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6963fa13-fede-4791-8dbf-ca2973f57991" returned: 0 in 0.601s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6963fa13-fede-4791-8dbf-ca2973f57991 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:13 devstack sudo[97888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6963fa13-fede-4791-8dbf-ca2973f57991
Sep 16 08:45:13 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:13 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6963fa13-fede-4791-8dbf-ca2973f57991" returned: 0 in 0.316s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Lock "cinder-quobyte-6963fa13-fede-4791-8dbf-ca2973f57991" released by "delete_volume" :: held 1.004s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=104,cinder:UPDATE=109,cinder:INSERT=28,cinder:DELETE=6 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=119,cinder:SELECT=117,cinder:DELETE=3,cinder:INSERT=26 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Created reservations ['3fb60c3d-4885-404a-8814-689ffc58e03c'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:14 devstack cinder-volume[86261]: WARNING cinder.quota [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1308481000 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1308481000, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:45:14 devstack cinder-volume[86261]: WARNING cinder.quota [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1308481000 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1308481000, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Created reservations ['ca70adfc-4ff2-4819-99b7-d73a80d3cdb7', '33bfd70a-08be-45a3-982a-7063cf4c71ad', 'bf50d521-306c-419b-9e42-f3fbe904ab75', '244c134b-f398-44ce-9c3f-f69707e6e3d1'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:14 devstack sudo[97898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:14 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:14 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.340s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:14 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:45:14 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9d764be0-2e52-45b7-9732-08ef8dee4129 tempest-GroupsTest-170149294 None] Delete group completed successfully.
Sep 16 08:45:15 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-cc5c81d9-4368-41b3-a1e0-61f2acee9789 tempest-GroupsTest-170149294 None] Created reservations ['318ad4f0-6ebc-4e48-a45f-d979b9987d90'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc5c81d9-4368-41b3-a1e0-61f2acee9789 tempest-GroupsTest-170149294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc5c81d9-4368-41b3-a1e0-61f2acee9789 tempest-GroupsTest-170149294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc5c81d9-4368-41b3-a1e0-61f2acee9789 tempest-GroupsTest-170149294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc5c81d9-4368-41b3-a1e0-61f2acee9789 tempest-GroupsTest-170149294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc5c81d9-4368-41b3-a1e0-61f2acee9789 tempest-GroupsTest-170149294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc5c81d9-4368-41b3-a1e0-61f2acee9789 tempest-GroupsTest-170149294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:15 devstack sudo[97912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:15 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:15 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc5c81d9-4368-41b3-a1e0-61f2acee9789 tempest-GroupsTest-170149294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.288s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:15 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-cc5c81d9-4368-41b3-a1e0-61f2acee9789 tempest-GroupsTest-170149294 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:45:15 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-cc5c81d9-4368-41b3-a1e0-61f2acee9789 tempest-GroupsTest-170149294 None] Delete group completed successfully.
Sep 16 08:45:17 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3e5dba6e-6521-4d84-9f26-abf0b683886b tempest-GroupsTest-170149294 None] Group tempest-GroupsTest-Group-644534056: creating
Sep 16 08:45:17 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3e5dba6e-6521-4d84-9f26-abf0b683886b tempest-GroupsTest-170149294 None] Group tempest-GroupsTest-Group-644534056: created successfully
Sep 16 08:45:17 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3e5dba6e-6521-4d84-9f26-abf0b683886b tempest-GroupsTest-170149294 None] Create group completed successfully.
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Flow 'volume_create_manager' (44e12cb3-7563-4cf9-9f5e-9e7ac871f539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52476519-0b4d-49d7-87fc-f1a4f70f6e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52476519-0b4d-49d7-87fc-f1a4f70f6e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-860112081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5c84f1d7-6f59-4e4e-8918-4fa1f0134466,host='devstack@QuobyteHD#QuobyteHD',id=187098a0-7f4e-43d2-bc12-39ad05e6b3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596eb16aa9c47069278fe2ce61bb61a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:19Z,use_quota=True,user_id='f7f45504a7a5486bae9fc156582c5886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb71f669-7345-4731-ba93-f7d7c227aee6),volume_type_id=fb71f669-7345-4731-ba93-f7d7c227aee6)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77a80fe-571e-4eca-b214-8ef367339717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77a80fe-571e-4eca-b214-8ef367339717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4a1872-9d61-49d1-b765-9133d2049e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4a1872-9d61-49d1-b765-9133d2049e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '187098a0-7f4e-43d2-bc12-39ad05e6b3c2', 'volume_name': 'volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b74d30c-8e52-4020-b570-c8e70a827e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b74d30c-8e52-4020-b570-c8e70a827e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d1d407-6b71-4336-8864-a55e681737f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:19 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Volume 187098a0-7f4e-43d2-bc12-39ad05e6b3c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2', 'volume_size': 1}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5c84f1d7-6f59-4e4e-8918-4fa1f0134466,created_at=2026-09-16T06:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-860112081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5c84f1d7-6f59-4e4e-8918-4fa1f0134466,host='devstack@QuobyteHD#QuobyteHD',id=187098a0-7f4e-43d2-bc12-39ad05e6b3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596eb16aa9c47069278fe2ce61bb61a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:19Z,use_quota=True,user_id='f7f45504a7a5486bae9fc156582c5886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb71f669-7345-4731-ba93-f7d7c227aee6),volume_type_id=fb71f669-7345-4731-ba93-f7d7c227aee6)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Creating volume 187098a0-7f4e-43d2-bc12-39ad05e6b3c2 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:45:19 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:19 devstack sudo[97916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2 1073741824
Sep 16 08:45:19 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:19 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2 1073741824" returned: 0 in 0.556s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:20 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2
Sep 16 08:45:20 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:20 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2" returned: 0 in 0.365s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:45:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d1d407-6b71-4336-8864-a55e681737f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4ce28f-b151-45c6-a7a8-8f2c0b6e3f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:20 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Volume volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2 (187098a0-7f4e-43d2-bc12-39ad05e6b3c2): created successfully
Sep 16 08:45:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4ce28f-b151-45c6-a7a8-8f2c0b6e3f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Flow 'volume_create_manager' (44e12cb3-7563-4cf9-9f5e-9e7ac871f539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:20 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ff73eda1-81f8-478d-af15-fb6717edcc4e tempest-GroupsTest-170149294 None] Created volume successfully.
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Flow 'volume_create_manager' (0f6e616d-f403-43b3-9cce-073c83a84912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b105d4-2e52-4744-8591-cdf254c1a751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b105d4-2e52-4744-8591-cdf254c1a751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1729770433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5c84f1d7-6f59-4e4e-8918-4fa1f0134466,host='devstack@QuobyteHD#QuobyteHD',id=fa79a1f6-5204-4e67-b508-3cf16afb2039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596eb16aa9c47069278fe2ce61bb61a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:22Z,use_quota=True,user_id='f7f45504a7a5486bae9fc156582c5886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb71f669-7345-4731-ba93-f7d7c227aee6),volume_type_id=fb71f669-7345-4731-ba93-f7d7c227aee6)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395c7ff9-2c2c-4cee-beb2-4869292bee06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395c7ff9-2c2c-4cee-beb2-4869292bee06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0776c410-ac5a-4370-9a31-0396dc8a4432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0776c410-ac5a-4370-9a31-0396dc8a4432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa79a1f6-5204-4e67-b508-3cf16afb2039', 'volume_name': 'volume-fa79a1f6-5204-4e67-b508-3cf16afb2039', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe43607-3820-4860-8fac-b7ce64404c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe43607-3820-4860-8fac-b7ce64404c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758e66b6-c58a-4833-9432-9aef62305655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:22 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Volume fa79a1f6-5204-4e67-b508-3cf16afb2039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa79a1f6-5204-4e67-b508-3cf16afb2039', 'volume_size': 1}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5c84f1d7-6f59-4e4e-8918-4fa1f0134466,created_at=2026-09-16T06:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1729770433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5c84f1d7-6f59-4e4e-8918-4fa1f0134466,host='devstack@QuobyteHD#QuobyteHD',id=fa79a1f6-5204-4e67-b508-3cf16afb2039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c596eb16aa9c47069278fe2ce61bb61a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:22Z,use_quota=True,user_id='f7f45504a7a5486bae9fc156582c5886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb71f669-7345-4731-ba93-f7d7c227aee6),volume_type_id=fb71f669-7345-4731-ba93-f7d7c227aee6)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Creating volume fa79a1f6-5204-4e67-b508-3cf16afb2039 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:45:22 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:45:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fa79a1f6-5204-4e67-b508-3cf16afb2039 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:22 devstack sudo[97930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fa79a1f6-5204-4e67-b508-3cf16afb2039 1073741824
Sep 16 08:45:22 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:23 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fa79a1f6-5204-4e67-b508-3cf16afb2039 1073741824" returned: 0 in 0.875s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fa79a1f6-5204-4e67-b508-3cf16afb2039 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:23 devstack sudo[97979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fa79a1f6-5204-4e67-b508-3cf16afb2039
Sep 16 08:45:23 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:24 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fa79a1f6-5204-4e67-b508-3cf16afb2039" returned: 0 in 0.602s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:45:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758e66b6-c58a-4833-9432-9aef62305655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa79a1f6-5204-4e67-b508-3cf16afb2039', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31608fbe-2973-4074-b4c1-b549f80c5c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:24 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Volume volume-fa79a1f6-5204-4e67-b508-3cf16afb2039 (fa79a1f6-5204-4e67-b508-3cf16afb2039): created successfully
Sep 16 08:45:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31608fbe-2973-4074-b4c1-b549f80c5c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Flow 'volume_create_manager' (0f6e616d-f403-43b3-9cce-073c83a84912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:24 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b7a3e7d5-f021-4109-b7e3-080e4c873ad7 tempest-GroupsTest-170149294 None] Created volume successfully.
Sep 16 08:45:25 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-083ae3fa-3d30-4b0e-a75a-07c4d7eab15d tempest-GroupsTest-170149294 None] Update group completed successfully.
Sep 16 08:45:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1285b5f9-1628-426f-bd5b-ef07e680b822 tempest-GroupsTest-170149294 None] Update group completed successfully.
Sep 16 08:45:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Acquiring lock "cinder-quobyte-187098a0-7f4e-43d2-bc12-39ad05e6b3c2" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Lock "cinder-quobyte-187098a0-7f4e-43d2-bc12-39ad05e6b3c2" acquired by "delete_volume" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:29 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[754a717d-80d3-40ed-a0ac-67a7b0afe9fc]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:29 devstack sudo[98035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2
Sep 16 08:45:29 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:29 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2" returned: 0 in 0.460s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:29 devstack sudo[98042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2
Sep 16 08:45:29 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:29 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187098a0-7f4e-43d2-bc12-39ad05e6b3c2" returned: 0 in 0.487s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Lock "cinder-quobyte-187098a0-7f4e-43d2-bc12-39ad05e6b3c2" released by "delete_volume" :: held 1.044s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Acquiring lock "cinder-quobyte-fa79a1f6-5204-4e67-b508-3cf16afb2039" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Lock "cinder-quobyte-fa79a1f6-5204-4e67-b508-3cf16afb2039" acquired by "delete_volume" :: waited 0.031s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:30 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3964b689-788b-45a0-87f9-4f6efd99bd8c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fa79a1f6-5204-4e67-b508-3cf16afb2039 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:30 devstack sudo[98045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fa79a1f6-5204-4e67-b508-3cf16afb2039
Sep 16 08:45:30 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:31 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fa79a1f6-5204-4e67-b508-3cf16afb2039" returned: 0 in 1.059s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fa79a1f6-5204-4e67-b508-3cf16afb2039 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:31 devstack sudo[98101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fa79a1f6-5204-4e67-b508-3cf16afb2039
Sep 16 08:45:31 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:31 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fa79a1f6-5204-4e67-b508-3cf16afb2039" returned: 0 in 0.529s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Lock "cinder-quobyte-fa79a1f6-5204-4e67-b508-3cf16afb2039" released by "delete_volume" :: held 1.692s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:31 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Created reservations ['04fd7bef-a33c-4a4b-aeac-eca254a2e76b'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:32 devstack cinder-volume[86261]: WARNING cinder.quota [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-888773712 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-888773712, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:45:32 devstack cinder-volume[86261]: WARNING cinder.quota [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-888773712 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-888773712, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:45:32 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Created reservations ['91808160-db7e-4c5e-9420-1679082d792c', '57da6cee-6e14-43cf-8bdf-a0c5a1624ac6', 'd1d23230-377d-417f-92a1-0d1cf2f8933b', '9be4db64-c61c-47ab-9aca-12d3bbf78233'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:32 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Created reservations ['e51a172f-eb8e-4650-a3d1-c02ab9feecee', '273854c9-774f-44c1-9586-f8462a2d11c4', '7cc08a78-be90-4297-a0d4-240b9bfecac8', 'e6e15e46-e3b6-4df8-b955-e606e26905f9'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:32 devstack sudo[98121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:32 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:33 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.446s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:33 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:45:33 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9126a243-3c71-46a5-8956-c017b8a23cac tempest-GroupsTest-170149294 None] Delete group completed successfully.
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Flow 'volume_create_manager' (04e5c2e2-684b-4d32-ac12-a09070a8c9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034f089c-d0e0-40a1-a6aa-7a38be185b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034f089c-d0e0-40a1-a6aa-7a38be185b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1449766047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bf8425-2dd9-4abf-be3e-e8ae66edb23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611d3d1996b476088abd9037669dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:35Z,use_quota=True,user_id='2d21d91b95164eab965d9280305b41be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1f61e9-77a4-4a53-a7a5-2a92e3ad416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1f61e9-77a4-4a53-a7a5-2a92e3ad416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff686159-c8ed-42b5-ad58-2c1578e56722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff686159-c8ed-42b5-ad58-2c1578e56722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bf8425-2dd9-4abf-be3e-e8ae66edb23e', 'volume_name': 'volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3fc3ca-0625-4af4-8072-45667d37d654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3fc3ca-0625-4af4-8072-45667d37d654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5c7093-57c1-44a0-afa5-2961f23408ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:35 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Volume d2bf8425-2dd9-4abf-be3e-e8ae66edb23e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e', 'volume_size': 1}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1449766047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bf8425-2dd9-4abf-be3e-e8ae66edb23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611d3d1996b476088abd9037669dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:35Z,use_quota=True,user_id='2d21d91b95164eab965d9280305b41be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Creating volume d2bf8425-2dd9-4abf-be3e-e8ae66edb23e {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:45:35 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:45:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:35 devstack sudo[98127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e 1073741824
Sep 16 08:45:35 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:36 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e 1073741824" returned: 0 in 0.888s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:36 devstack sudo[98133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e
Sep 16 08:45:36 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:37 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e" returned: 0 in 0.334s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:45:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5c7093-57c1-44a0-afa5-2961f23408ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b8c145-dfd8-42dd-a861-93f60f30e3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:37 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Volume volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e (d2bf8425-2dd9-4abf-be3e-e8ae66edb23e): created successfully
Sep 16 08:45:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b8c145-dfd8-42dd-a861-93f60f30e3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Flow 'volume_create_manager' (04e5c2e2-684b-4d32-ac12-a09070a8c9d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0331a058-a527-46a9-81e5-a28eb52b4d13 tempest-VolumesActionsTest-881037041 None] Created volume successfully.
Sep 16 08:45:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8f5d38e5-8d76-4692-901a-7f1d122e76a3 tempest-VolumesActionsTest-881037041 None] Acquiring lock "cinder-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e" by "attach_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8f5d38e5-8d76-4692-901a-7f1d122e76a3 tempest-VolumesActionsTest-881037041 None] Lock "cinder-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e" acquired by "attach_volume" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8f5d38e5-8d76-4692-901a-7f1d122e76a3 tempest-VolumesActionsTest-881037041 None] Attaching volume d2bf8425-2dd9-4abf-be3e-e8ae66edb23e to instance 3d7efe98-a590-439d-a73a-ce440601f119 at mountpoint /dev/vdb on host None.
Sep 16 08:45:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8f5d38e5-8d76-4692-901a-7f1d122e76a3 tempest-VolumesActionsTest-881037041 None] Attach volume completed successfully.
Sep 16 08:45:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8f5d38e5-8d76-4692-901a-7f1d122e76a3 tempest-VolumesActionsTest-881037041 None] Lock "cinder-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e" released by "attach_volume" :: held 0.214s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8d8a9b82-3a0d-48ad-8000-57bcc892c866 tempest-VolumesActionsTest-1116291258 None] Terminate volume connection completed successfully.
Sep 16 08:45:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8d8a9b82-3a0d-48ad-8000-57bcc892c866 tempest-VolumesActionsTest-1116291258 None] Acquiring lock "cinder-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e-detach_volume" by "detach_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8d8a9b82-3a0d-48ad-8000-57bcc892c866 tempest-VolumesActionsTest-1116291258 None] Lock "cinder-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:39 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8d8a9b82-3a0d-48ad-8000-57bcc892c866 tempest-VolumesActionsTest-1116291258 None] Detaching volume d2bf8425-2dd9-4abf-be3e-e8ae66edb23e from instance 3d7efe98-a590-439d-a73a-ce440601f119.
Sep 16 08:45:39 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8d8a9b82-3a0d-48ad-8000-57bcc892c866 tempest-VolumesActionsTest-1116291258 None] Detach volume completed successfully.
Sep 16 08:45:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8d8a9b82-3a0d-48ad-8000-57bcc892c866 tempest-VolumesActionsTest-1116291258 None] Lock "cinder-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ae8d834c-b13a-4a99-b1b6-869fecab50f4 tempest-VolumesActionsTest-881037041 None] Acquiring lock "cinder-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e-detach_volume" by "detach_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ae8d834c-b13a-4a99-b1b6-869fecab50f4 tempest-VolumesActionsTest-881037041 None] Lock "cinder-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:39 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ae8d834c-b13a-4a99-b1b6-869fecab50f4 tempest-VolumesActionsTest-881037041 None] Volume detach called, but volume not attached.
Sep 16 08:45:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ae8d834c-b13a-4a99-b1b6-869fecab50f4 tempest-VolumesActionsTest-881037041 None] Lock "cinder-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Acquiring lock "cinder-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Lock "cinder-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Acquiring lock "cinder-quobyte-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Lock "cinder-quobyte-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e" acquired by "delete_volume" :: waited 0.034s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:39 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[09360354-e11b-406f-b8ab-890f2204c4b1]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:40 devstack sudo[98171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e
Sep 16 08:45:40 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:40 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e" returned: 0 in 0.505s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:40 devstack sudo[98177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e
Sep 16 08:45:40 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:40 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e" returned: 0 in 0.316s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Lock "cinder-quobyte-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e" released by "delete_volume" :: held 0.903s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:40 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Created reservations ['4d788c35-f2a6-468f-bb07-965ea8f39010', '769996ff-1837-4bc6-bde3-9cca5ee8b37a', '72d22ffd-28e1-4ccc-9348-b08eda7be44f', '2dfea685-c41a-415c-95c5-a9de5119fdfa'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:41 devstack sudo[98180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:41 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:41 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:45:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Flow 'volume_create_manager' (b9b08f6d-5cb2-4560-8f9f-d8243eae41e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac0113f-af0d-4445-af7b-173a3735f6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac0113f-af0d-4445-af7b-173a3735f6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b53ae1a-2ec7-4774-b910-c217c2db345b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89aeb23bb69147a389065be2d9b8c604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:41Z,use_quota=True,user_id='3925ff25ebd248968a7f716b4784689e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(834ca8d0-6646-4e47-8832-188076d2fc3e),volume_type_id=834ca8d0-6646-4e47-8832-188076d2fc3e)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41789057-7b81-4c8b-ad20-df2b4ddd7251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41789057-7b81-4c8b-ad20-df2b4ddd7251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddbccac-61dd-41c1-936b-aacbc9aa2514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:41 devstack cinder-volume[86261]: DEBUG cinder.image.glance [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Creating Keystone auth plugin from conf {{(pid=86261) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 08:45:41 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.501s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:41 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:45:41 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Deleted volume successfully.
Sep 16 08:45:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cc45e7ed-0925-4d2b-a75b-f934372cae3d tempest-VolumesActionsTest-881037041 None] Lock "cinder-d2bf8425-2dd9-4abf-be3e-e8ae66edb23e-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddbccac-61dd-41c1-936b-aacbc9aa2514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b53ae1a-2ec7-4774-b910-c217c2db345b', 'volume_name': 'volume-2b53ae1a-2ec7-4774-b910-c217c2db345b', 'volume_size': 1, 'image_id': 'ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b34de9896d70ab697459472ef5a5c1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '89aeb23bb69147a389065be2d9b8c604', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '56dcd7278606fc25eb3f129927b79684b4e30852607a8b6bccdf19cbea12273f8ef69c0c19af6522490f33f49316ee0c6600495f049e99275b2f503a9607da11', 'id': 'ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'created_at': datetime.datetime(2026, 9, 16, 6, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 45, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad9d4fd4-4ac7-477d-8200-cd79b1e696b2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0e4f40d40>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02edbf29-e272-41fe-9ffe-186e66127c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02edbf29-e272-41fe-9ffe-186e66127c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5b938f-33d9-44f7-8f94-6234a7bb70f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:42 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Volume 2b53ae1a-2ec7-4774-b910-c217c2db345b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b53ae1a-2ec7-4774-b910-c217c2db345b', 'volume_size': 1, 'image_id': 'ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b34de9896d70ab697459472ef5a5c1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '89aeb23bb69147a389065be2d9b8c604', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '56dcd7278606fc25eb3f129927b79684b4e30852607a8b6bccdf19cbea12273f8ef69c0c19af6522490f33f49316ee0c6600495f049e99275b2f503a9607da11', 'id': 'ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'created_at': datetime.datetime(2026, 9, 16, 6, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 45, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad9d4fd4-4ac7-477d-8200-cd79b1e696b2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0e4f40d40>}
Sep 16 08:45:42 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Trying to clone 2b53ae1a-2ec7-4774-b910-c217c2db345b from image ad9d4fd4-4ac7-477d-8200-cd79b1e696b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'metadata': {}}]). {{(pid=86261) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 08:45:42 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 08:45:42 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 08:45:42 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[290a545e-8b54-4050-ab60-aa5de3f5c00b]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:42 devstack sudo[98219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD
Sep 16 08:45:42 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:42 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:43 devstack sudo[98239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD
Sep 16 08:45:43 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:43 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:45:43 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Temporary image ad9d4fd4-4ac7-477d-8200-cd79b1e696b2 is fetched for user 3925ff25ebd248968a7f716b4784689e. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 08:45:43 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a616d078-f256-43e8-8263-9657d40829e0]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:43 devstack sudo[98250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD
Sep 16 08:45:43 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:43 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:43 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD
Sep 16 08:45:43 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:44 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b53ae1a-2ec7-4774-b910-c217c2db345b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89aeb23bb69147a389065be2d9b8c604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:41Z,use_quota=True,user_id='3925ff25ebd248968a7f716b4784689e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(834ca8d0-6646-4e47-8832-188076d2fc3e),volume_type_id=834ca8d0-6646-4e47-8832-188076d2fc3e)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Creating volume 2b53ae1a-2ec7-4774-b910-c217c2db345b {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:45:44 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:44 devstack sudo[98261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b 1073741824
Sep 16 08:45:44 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:44 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b 1073741824" returned: 0 in 0.715s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:45 devstack sudo[98268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b
Sep 16 08:45:45 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:45 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b" returned: 0 in 0.298s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:45:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:45 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Attempting download of ad9d4fd4-4ac7-477d-8200-cd79b1e696b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'metadata': {}}])) to volume 2b53ae1a-2ec7-4774-b910-c217c2db345b. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 08:45:45 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a66a42-dfdf-458b-803b-07f9f5dea0e6]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_mbtw1sap {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:45 devstack sudo[98271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_mbtw1sap
Sep 16 08:45:45 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:45 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_mbtw1sap" returned: 0 in 0.449s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_mbtw1sap {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:45 devstack sudo[98275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_mbtw1sap
Sep 16 08:45:45 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Flow 'volume_create_manager' (df1d15af-ef64-4a56-a778-6b0371721626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ebc8f9-afcf-4320-92e6-10fc53a58075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ebc8f9-afcf-4320-92e6-10fc53a58075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-917288065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63521e37-edcd-4d6d-8d7d-6280c601f825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611d3d1996b476088abd9037669dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:46Z,use_quota=True,user_id='2d21d91b95164eab965d9280305b41be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd976acf-e455-4fa2-896d-5f0c11849b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd976acf-e455-4fa2-896d-5f0c11849b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c143afba-b264-4a6a-9cbb-3d359dc9764e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c143afba-b264-4a6a-9cbb-3d359dc9764e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63521e37-edcd-4d6d-8d7d-6280c601f825', 'volume_name': 'volume-63521e37-edcd-4d6d-8d7d-6280c601f825', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e45923-d936-497b-b115-dd0f4e41a6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:46 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e45923-d936-497b-b115-dd0f4e41a6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1ca18f-2aa7-4d63-9fa5-2394486cb23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:46 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Volume 63521e37-edcd-4d6d-8d7d-6280c601f825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63521e37-edcd-4d6d-8d7d-6280c601f825', 'volume_size': 1}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-917288065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63521e37-edcd-4d6d-8d7d-6280c601f825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611d3d1996b476088abd9037669dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:46Z,use_quota=True,user_id='2d21d91b95164eab965d9280305b41be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Creating volume 63521e37-edcd-4d6d-8d7d-6280c601f825 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:45:46 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63521e37-edcd-4d6d-8d7d-6280c601f825 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_mbtw1sap" returned: 1 in 0.492s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_mbtw1sap' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[678cc5b0-b45a-487f-98d8-26b2a52e02d7]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:46 devstack sudo[98279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63521e37-edcd-4d6d-8d7d-6280c601f825 1073741824
Sep 16 08:45:46 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:46 devstack sudo[98280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD
Sep 16 08:45:46 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:46 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:46 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63521e37-edcd-4d6d-8d7d-6280c601f825 1073741824" returned: 0 in 0.492s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:46 devstack sudo[98289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD
Sep 16 08:45:46 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63521e37-edcd-4d6d-8d7d-6280c601f825 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:46 devstack sudo[98291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63521e37-edcd-4d6d-8d7d-6280c601f825
Sep 16 08:45:46 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:47 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] ad9d4fd4-4ac7-477d-8200-cd79b1e696b2 was raw, converting to qcow2 {{(pid=86261) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:47 devstack sudo[98296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b
Sep 16 08:45:47 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:47 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63521e37-edcd-4d6d-8d7d-6280c601f825" returned: 0 in 0.282s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1ca18f-2aa7-4d63-9fa5-2394486cb23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63521e37-edcd-4d6d-8d7d-6280c601f825', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ff0291-56ee-4b66-a1a6-d7e7ba175ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:47 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Volume volume-63521e37-edcd-4d6d-8d7d-6280c601f825 (63521e37-edcd-4d6d-8d7d-6280c601f825): created successfully
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ff0291-56ee-4b66-a1a6-d7e7ba175ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Flow 'volume_create_manager' (df1d15af-ef64-4a56-a778-6b0371721626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:47 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-cc6e0ce8-1e89-4a78-9b4a-a5e2bf527613 tempest-VolumesActionsTest-881037041 None] Created volume successfully.
Sep 16 08:45:47 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b" returned: 0 in 0.491s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad9d4fd4-4ac7-477d-8200-cd79b1e696b2_lio1kgnidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:45:47 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:47 devstack sudo[98303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b 1G
Sep 16 08:45:47 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:47 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b 1G" returned: 0 in 0.329s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Downloaded image ad9d4fd4-4ac7-477d-8200-cd79b1e696b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'metadata': {}}])) to volume 2b53ae1a-2ec7-4774-b910-c217c2db345b successfully. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Temporary image ad9d4fd4-4ac7-477d-8200-cd79b1e696b2 for user 3925ff25ebd248968a7f716b4784689e is deleted. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Marking volume 2b53ae1a-2ec7-4774-b910-c217c2db345b as bootable. {{(pid=86261) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Copying metadata from image ad9d4fd4-4ac7-477d-8200-cd79b1e696b2 to 2b53ae1a-2ec7-4774-b910-c217c2db345b. {{(pid=86261) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Creating volume glance metadata for volume 2b53ae1a-2ec7-4774-b910-c217c2db345b backed by image ad9d4fd4-4ac7-477d-8200-cd79b1e696b2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2b34de9896d70ab697459472ef5a5c1f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86261) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5b938f-33d9-44f7-8f94-6234a7bb70f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b53ae1a-2ec7-4774-b910-c217c2db345b', 'volume_size': 1, 'image_id': 'ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b34de9896d70ab697459472ef5a5c1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '89aeb23bb69147a389065be2d9b8c604', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '56dcd7278606fc25eb3f129927b79684b4e30852607a8b6bccdf19cbea12273f8ef69c0c19af6522490f33f49316ee0c6600495f049e99275b2f503a9607da11', 'id': 'ad9d4fd4-4ac7-477d-8200-cd79b1e696b2', 'created_at': datetime.datetime(2026, 9, 16, 6, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 45, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad9d4fd4-4ac7-477d-8200-cd79b1e696b2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0e4f40d40>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2691a9ab-832e-45f6-8bed-505d82f76235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:48 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Volume volume-2b53ae1a-2ec7-4774-b910-c217c2db345b (2b53ae1a-2ec7-4774-b910-c217c2db345b): created successfully
Sep 16 08:45:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2691a9ab-832e-45f6-8bed-505d82f76235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Flow 'volume_create_manager' (b9b08f6d-5cb2-4560-8f9f-d8243eae41e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:48 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3ddbd6b0-5f05-4298-abca-721de6e03b2d tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Created volume successfully.
Sep 16 08:45:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Acquiring lock "cinder-63521e37-edcd-4d6d-8d7d-6280c601f825-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Lock "cinder-63521e37-edcd-4d6d-8d7d-6280c601f825-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Acquiring lock "cinder-quobyte-63521e37-edcd-4d6d-8d7d-6280c601f825" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Lock "cinder-quobyte-63521e37-edcd-4d6d-8d7d-6280c601f825" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:48 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d77d42a-fe50-4981-973e-22cc73522841]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63521e37-edcd-4d6d-8d7d-6280c601f825 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:48 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63521e37-edcd-4d6d-8d7d-6280c601f825
Sep 16 08:45:48 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Acquiring lock "cinder-2b53ae1a-2ec7-4774-b910-c217c2db345b-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Lock "cinder-2b53ae1a-2ec7-4774-b910-c217c2db345b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:48 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63521e37-edcd-4d6d-8d7d-6280c601f825" returned: 0 in 0.502s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63521e37-edcd-4d6d-8d7d-6280c601f825 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:49 devstack sudo[98326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63521e37-edcd-4d6d-8d7d-6280c601f825
Sep 16 08:45:49 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Acquiring lock "cinder-quobyte-2b53ae1a-2ec7-4774-b910-c217c2db345b" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Lock "cinder-quobyte-2b53ae1a-2ec7-4774-b910-c217c2db345b" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3150a0cc-8d3a-42fd-b113-2d12ba542e7a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:49 devstack sudo[98328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b
Sep 16 08:45:49 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:49 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63521e37-edcd-4d6d-8d7d-6280c601f825" returned: 0 in 0.468s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Lock "cinder-quobyte-63521e37-edcd-4d6d-8d7d-6280c601f825" released by "delete_volume" :: held 1.039s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Created reservations ['7a59e387-0670-4b87-a10a-885e138866d1', 'd92a5863-c8a9-4d22-a314-ead05c993283', '4e42ff3a-110a-4387-a78f-85eec34ecd73', '39ab84a8-5da4-466c-b8d4-c1a190875ec7'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:49 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:49 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:49 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b" returned: 0 in 0.586s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:49 devstack sudo[98336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b
Sep 16 08:45:49 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:49 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.311s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:49 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:45:49 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Deleted volume successfully.
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6a8a6075-5941-4cdc-8c4b-728a6b9d54bc tempest-VolumesActionsTest-1116291258 None] Lock "cinder-63521e37-edcd-4d6d-8d7d-6280c601f825-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:50 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-2b53ae1a-2ec7-4774-b910-c217c2db345b" returned: 0 in 0.372s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Lock "cinder-quobyte-2b53ae1a-2ec7-4774-b910-c217c2db345b" released by "delete_volume" :: held 1.029s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:50 devstack cinder-volume[86261]: WARNING cinder.quota [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:45:50 devstack cinder-volume[86261]: WARNING cinder.quota [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Created reservations ['df5f4151-653e-4726-82e1-7bdff75abc4d', 'fd7f5ea0-5f0b-4d06-b1ce-439e189b6b3d', '36391ebb-7b80-46b1-94d9-03c313551222', 'aa915713-5ade-4d02-97d0-1d474198605b'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:50 devstack sudo[98341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:50 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Flow 'volume_create_manager' (b150beb4-7301-4425-8f27-6448f826ee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05b2fac-6662-4b1e-9604-a9df409dd6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05b2fac-6662-4b1e-9604-a9df409dd6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1559090823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322608899a484fb0aabea11791bfc37e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:50Z,use_quota=True,user_id='c4cf9ee9d63b4293bdb265c95791ad0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7288bf-e1a5-4594-a869-2b422040091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7288bf-e1a5-4594-a869-2b422040091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bea307d-ce29-4515-8f76-dd462c263908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bea307d-ce29-4515-8f76-dd462c263908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746', 'volume_name': 'volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:50 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e5b62c-f62b-425e-92f9-de4ea8217971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e5b62c-f62b-425e-92f9-de4ea8217971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708e96f5-d6bc-415b-b025-9cdd7c062415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:50 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Volume ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746', 'volume_size': 1}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1559090823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322608899a484fb0aabea11791bfc37e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:50Z,use_quota=True,user_id='c4cf9ee9d63b4293bdb265c95791ad0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Creating volume ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:45:50 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.297s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:45:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Deleted volume successfully.
Sep 16 08:45:50 devstack sudo[98345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746 1073741824
Sep 16 08:45:50 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Flow 'volume_create_manager' (2af245b8-ad24-46ad-8e3e-3133f5b66490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5f7028-94e1-4240-a170-6d171467cb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5f7028-94e1-4240-a170-6d171467cb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1917256645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a5679c-dd2e-44e6-93ae-4f1e94c767e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e11fb5facb34f9ea50ac0ad373286d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:50Z,use_quota=True,user_id='bd8df42e2e324316ad00687914024450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea38df96-dc77-4679-8a0b-154a993ac15e),volume_type_id=ea38df96-dc77-4679-8a0b-154a993ac15e)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a7ffc8-961f-4cd4-a70d-bf2950e5f89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a7ffc8-961f-4cd4-a70d-bf2950e5f89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afd31bc-3b89-4ab4-8d63-7c86f193144a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afd31bc-3b89-4ab4-8d63-7c86f193144a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a5679c-dd2e-44e6-93ae-4f1e94c767e5', 'volume_name': 'volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc64adf-5e98-4221-bda1-ba24d9bb06d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc64adf-5e98-4221-bda1-ba24d9bb06d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0629b762-39fb-4388-b675-e52ff186ace8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:50 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Volume 95a5679c-dd2e-44e6-93ae-4f1e94c767e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5', 'volume_size': 1}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-38a3fad4-25fe-420a-af41-5852c2250e57 tempest-VolumeAndVolumeTypeFromImageTest-1963747679 None] Lock "cinder-2b53ae1a-2ec7-4774-b910-c217c2db345b-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:50 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746 1073741824" returned: 0 in 0.446s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:51 devstack sudo[98352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746
Sep 16 08:45:51 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Flow 'volume_create_manager' (f148ffee-fadd-4a02-b6c1-b54880fe6744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e83f6e2-8f9b-4adc-bf5e-882258b07fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e83f6e2-8f9b-4adc-bf5e-882258b07fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-627065291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1666d9bd-6210-4b83-89c9-052262a9b6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611d3d1996b476088abd9037669dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:51Z,use_quota=True,user_id='2d21d91b95164eab965d9280305b41be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c231ada0-246b-4e9c-9dd6-94d920c5eb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c231ada0-246b-4e9c-9dd6-94d920c5eb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbd108c-6920-49e4-b3a5-e3cd40316c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbd108c-6920-49e4-b3a5-e3cd40316c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1666d9bd-6210-4b83-89c9-052262a9b6fc', 'volume_name': 'volume-1666d9bd-6210-4b83-89c9-052262a9b6fc', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea010481-af33-46e0-996b-8cc74b3d5dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea010481-af33-46e0-996b-8cc74b3d5dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:51 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07eb54b7-ddc3-4019-bad8-8be38b006a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:51 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Volume 1666d9bd-6210-4b83-89c9-052262a9b6fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1666d9bd-6210-4b83-89c9-052262a9b6fc', 'volume_size': 1}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746" returned: 0 in 0.256s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1917256645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a5679c-dd2e-44e6-93ae-4f1e94c767e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e11fb5facb34f9ea50ac0ad373286d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:50Z,use_quota=True,user_id='bd8df42e2e324316ad00687914024450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea38df96-dc77-4679-8a0b-154a993ac15e),volume_type_id=ea38df96-dc77-4679-8a0b-154a993ac15e)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Creating volume 95a5679c-dd2e-44e6-93ae-4f1e94c767e5 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:45:51 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708e96f5-d6bc-415b-b025-9cdd7c062415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2398ce03-13a7-42c7-99a5-09d596d38729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:51 devstack sudo[98355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5 1073741824
Sep 16 08:45:51 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:51 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Volume volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746 (ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746): created successfully
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2398ce03-13a7-42c7-99a5-09d596d38729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Flow 'volume_create_manager' (b150beb4-7301-4425-8f27-6448f826ee2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:51 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d0a03e3a-b9fb-4c27-9d4e-710b0d186c15 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Created volume successfully.
Sep 16 08:45:51 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5 1073741824" returned: 0 in 0.474s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:51 devstack sudo[98362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5
Sep 16 08:45:51 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:52 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5" returned: 0 in 0.262s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.796s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-627065291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1666d9bd-6210-4b83-89c9-052262a9b6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611d3d1996b476088abd9037669dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:51Z,use_quota=True,user_id='2d21d91b95164eab965d9280305b41be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Creating volume 1666d9bd-6210-4b83-89c9-052262a9b6fc {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:45:52 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1666d9bd-6210-4b83-89c9-052262a9b6fc 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0629b762-39fb-4388-b675-e52ff186ace8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:52 devstack sudo[98365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1666d9bd-6210-4b83-89c9-052262a9b6fc 1073741824
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bb5f9f-00aa-4b7f-8072-a8da65d9a09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:52 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:52 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Volume volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5 (95a5679c-dd2e-44e6-93ae-4f1e94c767e5): created successfully
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bb5f9f-00aa-4b7f-8072-a8da65d9a09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Flow 'volume_create_manager' (2af245b8-ad24-46ad-8e3e-3133f5b66490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:52 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-969adb08-8243-4f1b-84d2-f83e3d363436 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Created volume successfully.
Sep 16 08:45:52 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1666d9bd-6210-4b83-89c9-052262a9b6fc 1073741824" returned: 0 in 0.609s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1666d9bd-6210-4b83-89c9-052262a9b6fc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:52 devstack sudo[98374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1666d9bd-6210-4b83-89c9-052262a9b6fc
Sep 16 08:45:52 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7083c908-a83e-4274-be2e-5e851852f1d4 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7083c908-a83e-4274-be2e-5e851852f1d4 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7083c908-a83e-4274-be2e-5e851852f1d4 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7083c908-a83e-4274-be2e-5e851852f1d4 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7083c908-a83e-4274-be2e-5e851852f1d4 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7083c908-a83e-4274-be2e-5e851852f1d4 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:53 devstack sudo[98376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:53 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:53 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1666d9bd-6210-4b83-89c9-052262a9b6fc" returned: 0 in 0.439s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07eb54b7-ddc3-4019-bad8-8be38b006a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1666d9bd-6210-4b83-89c9-052262a9b6fc', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c70d593-7613-4e2a-8b05-6fc7b3b8ef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:53 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Volume volume-1666d9bd-6210-4b83-89c9-052262a9b6fc (1666d9bd-6210-4b83-89c9-052262a9b6fc): created successfully
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c70d593-7613-4e2a-8b05-6fc7b3b8ef4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Flow 'volume_create_manager' (f148ffee-fadd-4a02-b6c1-b54880fe6744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:53 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7cfb51f8-dc20-450c-9353-a368ba2e75a1 tempest-VolumesActionsTest-881037041 None] Created volume successfully.
Sep 16 08:45:53 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7083c908-a83e-4274-be2e-5e851852f1d4 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.324s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-7083c908-a83e-4274-be2e-5e851852f1d4 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:45:53 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7083c908-a83e-4274-be2e-5e851852f1d4 tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Retype volume completed successfully.
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-d56e6f9d-51dc-4474-97a9-389967e72926 req-4cc00789-a72d-4c78-9f85-3a2e50f1cff6 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-d56e6f9d-51dc-4474-97a9-389967e72926 req-4cc00789-a72d-4c78-9f85-3a2e50f1cff6 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-d56e6f9d-51dc-4474-97a9-389967e72926 req-4cc00789-a72d-4c78-9f85-3a2e50f1cff6 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-d56e6f9d-51dc-4474-97a9-389967e72926 req-4cc00789-a72d-4c78-9f85-3a2e50f1cff6 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5901f5f-21b5-40e3-b64d-cf308bd4d92e', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:45:53 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-d56e6f9d-51dc-4474-97a9-389967e72926 req-4cc00789-a72d-4c78-9f85-3a2e50f1cff6 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] attachment_update completed successfully.
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Acquiring lock "cinder-95a5679c-dd2e-44e6-93ae-4f1e94c767e5-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Lock "cinder-95a5679c-dd2e-44e6-93ae-4f1e94c767e5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Acquiring lock "cinder-quobyte-95a5679c-dd2e-44e6-93ae-4f1e94c767e5" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Lock "cinder-quobyte-95a5679c-dd2e-44e6-93ae-4f1e94c767e5" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[11afb09e-67cc-4981-ab7b-9a4104cdc7a6]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:54 devstack sudo[98807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5
Sep 16 08:45:54 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Acquiring lock "cinder-1666d9bd-6210-4b83-89c9-052262a9b6fc-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Lock "cinder-1666d9bd-6210-4b83-89c9-052262a9b6fc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Acquiring lock "cinder-quobyte-1666d9bd-6210-4b83-89c9-052262a9b6fc" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Lock "cinder-quobyte-1666d9bd-6210-4b83-89c9-052262a9b6fc" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f08fbb-ea79-4f26-80c6-a337f4f5a73b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1666d9bd-6210-4b83-89c9-052262a9b6fc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:54 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5" returned: 0 in 0.481s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:54 devstack sudo[98813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5
Sep 16 08:45:54 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:54 devstack sudo[98810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1666d9bd-6210-4b83-89c9-052262a9b6fc
Sep 16 08:45:54 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:55 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-95a5679c-dd2e-44e6-93ae-4f1e94c767e5" returned: 0 in 0.289s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Lock "cinder-quobyte-95a5679c-dd2e-44e6-93ae-4f1e94c767e5" released by "delete_volume" :: held 0.878s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:55 devstack cinder-volume[86261]: WARNING cinder.quota [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:45:55 devstack cinder-volume[86261]: WARNING cinder.quota [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 16 08:45:55 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1666d9bd-6210-4b83-89c9-052262a9b6fc" returned: 0 in 0.460s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1666d9bd-6210-4b83-89c9-052262a9b6fc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:55 devstack sudo[98820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1666d9bd-6210-4b83-89c9-052262a9b6fc
Sep 16 08:45:55 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Created reservations ['3525b4fa-a9d0-41c8-a01a-13b557db387d', 'ce2a1a07-929d-45a5-aa72-79abc4e3768f', '8f45057f-dd5f-47ea-bdba-2650696c4899', 'b924540b-8d95-48e1-90ae-bce44a3674a7'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:55 devstack sudo[98822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:55 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:55 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1666d9bd-6210-4b83-89c9-052262a9b6fc" returned: 0 in 0.381s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Lock "cinder-quobyte-1666d9bd-6210-4b83-89c9-052262a9b6fc" released by "delete_volume" :: held 0.894s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Created reservations ['c9315332-73f7-4f88-a303-bb592985e509', '459d6130-56fd-4997-a2c1-90ec2d6ae48e', '57dca66a-f3f3-4b06-9f1f-dfe7cd5fdc16', 'ce4a3e12-a647-4d29-b55e-3ba32e7e2809'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:55 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.351s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:45:55 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Deleted volume successfully.
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3614948f-054c-45a2-bb36-1ead128c91cc tempest-VolumeRetypeWithoutMigrationTest-171000877 None] Lock "cinder-95a5679c-dd2e-44e6-93ae-4f1e94c767e5-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:55 devstack sudo[98826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:55 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:56 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.362s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:45:56 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Deleted volume successfully.
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fd9448b5-2ddf-495c-bfe7-5088c0fedb94 tempest-VolumesActionsTest-1116291258 None] Lock "cinder-1666d9bd-6210-4b83-89c9-052262a9b6fc-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Flow 'volume_create_manager' (86bccfd0-5543-4b40-b4fc-96a42241d32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b2a4ef-a590-41d4-8849-fe5509a2b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b2a4ef-a590-41d4-8849-fe5509a2b976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-205335417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0961e2f-85ef-4a5f-9730-8abff5b85e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611d3d1996b476088abd9037669dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:57Z,use_quota=True,user_id='2d21d91b95164eab965d9280305b41be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c700ed-17f4-4a58-82a8-bef51ce0f288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c700ed-17f4-4a58-82a8-bef51ce0f288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eab988c-dba9-4b4e-97a3-3f3160aed705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eab988c-dba9-4b4e-97a3-3f3160aed705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0961e2f-85ef-4a5f-9730-8abff5b85e9e', 'volume_name': 'volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc31e7fe-996a-4d13-9d94-9fce56402370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc31e7fe-996a-4d13-9d94-9fce56402370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b6b467-0147-4cd5-934d-ec1f97e70b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:56 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Volume d0961e2f-85ef-4a5f-9730-8abff5b85e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e', 'volume_size': 1}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-205335417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0961e2f-85ef-4a5f-9730-8abff5b85e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611d3d1996b476088abd9037669dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:57Z,use_quota=True,user_id='2d21d91b95164eab965d9280305b41be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Creating volume d0961e2f-85ef-4a5f-9730-8abff5b85e9e {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:45:56 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:45:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:56 devstack sudo[98829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e 1073741824
Sep 16 08:45:56 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:57 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e 1073741824" returned: 0 in 0.650s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:57 devstack sudo[98835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e
Sep 16 08:45:57 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Flow 'volume_create_manager' (33f5c52e-0773-4d8a-8eb3-160ccbd5f064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9815c4-0a7c-4164-bfe4-a1a91ad505f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9815c4-0a7c-4164-bfe4-a1a91ad505f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1202667711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908c3702-2c76-4a64-b438-70ab444c7854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cefd48a8b4437930deda2e5e1022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:58Z,use_quota=True,user_id='75efb95ac63548caac60c20f96584345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e5e75a-6429-4748-a764-e97c7ef01ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e5e75a-6429-4748-a764-e97c7ef01ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a657b6-beb6-4725-9f02-ebe2ba5e80d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:57 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a657b6-beb6-4725-9f02-ebe2ba5e80d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908c3702-2c76-4a64-b438-70ab444c7854', 'volume_name': 'volume-908c3702-2c76-4a64-b438-70ab444c7854', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251b669c-c945-4ba0-a411-c16c4f89655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251b669c-c945-4ba0-a411-c16c4f89655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ff2516-88d6-4414-8923-668ad5e247a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:57 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume 908c3702-2c76-4a64-b438-70ab444c7854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908c3702-2c76-4a64-b438-70ab444c7854', 'volume_size': 1}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e" returned: 0 in 0.386s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1202667711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908c3702-2c76-4a64-b438-70ab444c7854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cefd48a8b4437930deda2e5e1022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:45:58Z,use_quota=True,user_id='75efb95ac63548caac60c20f96584345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Creating volume 908c3702-2c76-4a64-b438-70ab444c7854 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:45:57 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:57 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-fb1c5be1-ea78-4a7d-9eba-7c721de6cdf0 req-c54df29f-ca4d-4e39-bbc8-bdf2b400895c tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Terminate volume connection completed successfully.
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-fb1c5be1-ea78-4a7d-9eba-7c721de6cdf0 req-c54df29f-ca4d-4e39-bbc8-bdf2b400895c tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Deleting attachment c5901f5f-21b5-40e3-b64d-cf308bd4d92e. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b6b467-0147-4cd5-934d-ec1f97e70b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:57 devstack sudo[98865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854 1073741824
Sep 16 08:45:57 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4852265a-6977-46a2-99da-4d2987f75ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:57 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Volume volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e (d0961e2f-85ef-4a5f-9730-8abff5b85e9e): created successfully
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4852265a-6977-46a2-99da-4d2987f75ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Flow 'volume_create_manager' (86bccfd0-5543-4b40-b4fc-96a42241d32b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:57 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c9d7cc1c-6f71-40f3-8f77-74270c43c085 tempest-VolumesActionsTest-881037041 None] Created volume successfully.
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Acquiring lock "cinder-d0961e2f-85ef-4a5f-9730-8abff5b85e9e-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Lock "cinder-d0961e2f-85ef-4a5f-9730-8abff5b85e9e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Acquiring lock "cinder-quobyte-d0961e2f-85ef-4a5f-9730-8abff5b85e9e" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Lock "cinder-quobyte-d0961e2f-85ef-4a5f-9730-8abff5b85e9e" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:58 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854 1073741824" returned: 0 in 0.612s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ea8abe-f6a3-4724-8a24-4829789246f7]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:58 devstack sudo[98871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854
Sep 16 08:45:58 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Acquiring lock "cinder-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Lock "cinder-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:58 devstack sudo[98870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e
Sep 16 08:45:58 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Acquiring lock "cinder-quobyte-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Lock "cinder-quobyte-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[13782804-eb8f-4d2e-849e-c072c88e2286]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:58 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854" returned: 0 in 0.354s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:58 devstack sudo[98874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746
Sep 16 08:45:58 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ff2516-88d6-4414-8923-668ad5e247a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908c3702-2c76-4a64-b438-70ab444c7854', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab4ce6e-8f68-4789-b1e1-7c595d1be5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:45:58 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume volume-908c3702-2c76-4a64-b438-70ab444c7854 (908c3702-2c76-4a64-b438-70ab444c7854): created successfully
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab4ce6e-8f68-4789-b1e1-7c595d1be5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:45:58 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Flow 'volume_create_manager' (33f5c52e-0773-4d8a-8eb3-160ccbd5f064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e" returned: 0 in 0.506s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:58 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b8d296b0-c892-4367-893a-da450c4924ea tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created volume successfully.
Sep 16 08:45:58 devstack sudo[98880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e
Sep 16 08:45:58 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:59 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746" returned: 0 in 0.456s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:59 devstack sudo[98886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746
Sep 16 08:45:59 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:59 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0961e2f-85ef-4a5f-9730-8abff5b85e9e" returned: 0 in 0.296s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Lock "cinder-quobyte-d0961e2f-85ef-4a5f-9730-8abff5b85e9e" released by "delete_volume" :: held 0.867s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Created reservations ['ca2ea48a-f892-48fa-aa8f-c56d10d40228', '9f66d732-c6ad-4ad8-a8d5-57169b10aa8f', '25e8b478-8f89-49bd-8b63-2a4d3396fd0b', 'fb3f7f85-1676-425a-bb71-5d71763c54e4'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:59 devstack sudo[98888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:59 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:59 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746" returned: 0 in 0.294s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Lock "cinder-quobyte-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746" released by "delete_volume" :: held 0.829s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Created reservations ['cddd7481-38e7-440f-addf-45c7d1f6b9d0', 'e3500098-0d1f-4ab9-a921-28f3bc7d0cb4', '9aea268d-d113-4f13-862e-75390d935a8d', '98663502-b977-4ea9-a84f-d713e1879e5c'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:45:59 devstack sudo[98892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:45:59 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:45:59 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.320s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:45:59 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Deleted volume successfully.
Sep 16 08:45:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1b4171ce-993c-44d7-91be-bd16496971c1 tempest-VolumesActionsTest-1116291258 None] Lock "cinder-d0961e2f-85ef-4a5f-9730-8abff5b85e9e-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:00 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.399s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:00 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Deleted volume successfully.
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-82030f3b-3d9e-476b-ab82-23e049e7adc4 tempest-TestServerVolumeAttachScenarioOldVersion-772081195 None] Lock "cinder-ff6d8a3f-4e10-4d97-9ad3-d7b9628aa746-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] Creating offline snapshot 26a89961-9ae8-4c54-b264-d685ff9dd711 of volume 908c3702-2c76-4a64-b438-70ab444c7854 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8624ccf1-e827-4d9e-b50b-a13c076b7dce]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:00 devstack sudo[98895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854
Sep 16 08:46:00 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Flow 'volume_create_manager' (81aabe4e-4748-40bd-826b-87eff0e0312a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3843179b-5b8f-4125-9416-8ee135d77550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3843179b-5b8f-4125-9416-8ee135d77550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847647889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d5bf92-012f-4d15-bb51-7b8de0921a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611d3d1996b476088abd9037669dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:00Z,use_quota=True,user_id='2d21d91b95164eab965d9280305b41be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e4ba66-685c-4d45-9455-85761d686093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e4ba66-685c-4d45-9455-85761d686093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274d65f0-d4b0-4163-872f-df0bcc2084f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274d65f0-d4b0-4163-872f-df0bcc2084f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d5bf92-012f-4d15-bb51-7b8de0921a23', 'volume_name': 'volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ed9c67-e253-4238-820b-910faa7dd551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ed9c67-e253-4238-820b-910faa7dd551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0379d12e-aadd-4944-812f-f4583599108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:00 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Volume d0d5bf92-012f-4d15-bb51-7b8de0921a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23', 'volume_size': 1}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:00 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854" returned: 0 in 0.660s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:00 devstack sudo[98920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711 1G
Sep 16 08:46:00 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:01 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711 1G" returned: 0 in 0.535s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-908c3702-2c76-4a64-b438-70ab444c7854 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:01 devstack sudo[98927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-908c3702-2c76-4a64-b438-70ab444c7854 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711
Sep 16 08:46:01 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:01 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-908c3702-2c76-4a64-b438-70ab444c7854 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711" returned: 0 in 0.345s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:01 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711 is being set with open permissions: ugo+rw
Sep 16 08:46:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:01 devstack sudo[98933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711
Sep 16 08:46:01 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:02 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711" returned: 0 in 0.308s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:02 devstack sudo[98937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.info
Sep 16 08:46:02 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:02 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.info" returned: 0 in 0.389s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:02 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.info is being set with open permissions: ugo+rw
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:02 devstack sudo[98941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.info
Sep 16 08:46:02 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:02 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.info" returned: 0 in 0.316s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.694s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.135s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847647889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d5bf92-012f-4d15-bb51-7b8de0921a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611d3d1996b476088abd9037669dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:00Z,use_quota=True,user_id='2d21d91b95164eab965d9280305b41be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Creating volume d0d5bf92-012f-4d15-bb51-7b8de0921a23 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:02 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:02 devstack sudo[98944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23 1073741824
Sep 16 08:46:02 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:02 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-052714a0-f106-4302-884b-2608fb1ce0ac tempest-CreateVolumesFromSnapshotTest-1794956959 None] Create snapshot completed successfully
Sep 16 08:46:03 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23 1073741824" returned: 0 in 0.581s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:03 devstack sudo[98950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23
Sep 16 08:46:03 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:03 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23" returned: 0 in 0.452s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0379d12e-aadd-4944-812f-f4583599108d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e707cb-3b77-409c-a14d-7a4c24ff44ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:03 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Volume volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23 (d0d5bf92-012f-4d15-bb51-7b8de0921a23): created successfully
Sep 16 08:46:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e707cb-3b77-409c-a14d-7a4c24ff44ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Flow 'volume_create_manager' (81aabe4e-4748-40bd-826b-87eff0e0312a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:04 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5a8eca74-fd07-4272-a05a-d27357e1bca1 tempest-VolumesActionsTest-881037041 None] Created volume successfully.
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Flow 'volume_create_manager' (438d99b6-a9eb-470d-99c4-f2f2dd70a693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a730072-5b24-49c7-a3fc-07e3e1946c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a730072-5b24-49c7-a3fc-07e3e1946c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1695435588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bc9d96-bdad-46b8-8e59-640d47ad73c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cefd48a8b4437930deda2e5e1022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:04Z,use_quota=True,user_id='75efb95ac63548caac60c20f96584345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96596ce7-5b8f-49c3-9685-dec21a8eaf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96596ce7-5b8f-49c3-9685-dec21a8eaf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abebf35-6262-41fd-b478-9a03b04a6834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abebf35-6262-41fd-b478-9a03b04a6834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62bc9d96-bdad-46b8-8e59-640d47ad73c2', 'volume_name': 'volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63453fc1-3f21-4b66-b4e5-a710f2aa604e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63453fc1-3f21-4b66-b4e5-a710f2aa604e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462420e4-9f82-4c4b-8ee5-3a52091c9952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume 62bc9d96-bdad-46b8-8e59-640d47ad73c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2', 'volume_size': 1}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1695435588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bc9d96-bdad-46b8-8e59-640d47ad73c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cefd48a8b4437930deda2e5e1022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:04Z,use_quota=True,user_id='75efb95ac63548caac60c20f96584345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Creating volume 62bc9d96-bdad-46b8-8e59-640d47ad73c2 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:04 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:04 devstack sudo[98954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2 1073741824
Sep 16 08:46:04 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Flow 'volume_create_manager' (13fd1683-97e3-4ac8-802c-d85ecd069423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bff18de-d8f3-4da1-b5df-14404e124832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bff18de-d8f3-4da1-b5df-14404e124832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1837546895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f086416-e0e0-482e-b0fc-aea8e154c9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6323267ee4f940c18ea5cdb44781597d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:04Z,use_quota=True,user_id='751cbf3a6bb04e5189feb4db1a69ddda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f275de-5de4-4900-a84d-e92a7308f0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f275de-5de4-4900-a84d-e92a7308f0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5bfbc9d-3119-42e5-9422-983bf3198011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5bfbc9d-3119-42e5-9422-983bf3198011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f086416-e0e0-482e-b0fc-aea8e154c9ee', 'volume_name': 'volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef58cf4-5721-47ab-844b-3e0983953dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef58cf4-5721-47ab-844b-3e0983953dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174e75c4-7d56-4f19-a39e-c17a6db54117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Volume 3f086416-e0e0-482e-b0fc-aea8e154c9ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee', 'volume_size': 1}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Flow 'volume_create_manager' (2c3a92e9-cf90-426c-b7f0-3ebeadd7ae8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba513b06-a878-4456-8575-6a83504a82ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba513b06-a878-4456-8575-6a83504a82ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-306935144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cefd48a8b4437930deda2e5e1022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:04Z,use_quota=True,user_id='75efb95ac63548caac60c20f96584345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb4cca8-3ee6-4003-af99-ed7993bfb685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb4cca8-3ee6-4003-af99-ed7993bfb685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57707358-fbf9-411c-b052-0f62062097a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57707358-fbf9-411c-b052-0f62062097a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21', 'volume_name': 'volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68df7e09-bbd9-428d-8ecb-e9824cac498e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68df7e09-bbd9-428d-8ecb-e9824cac498e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2ee286-2788-4482-9494-42290c1b08ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:04 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21', 'volume_size': 1}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:04 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2 1073741824" returned: 0 in 0.641s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:04 devstack sudo[98959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2
Sep 16 08:46:04 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:04 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Flow 'volume_create_manager' (636ed2d1-d082-4523-9f71-defbbcc6d5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3016fc0a-d548-407b-b90d-b3543009cdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3016fc0a-d548-407b-b90d-b3543009cdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1353496528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dae7390-8fe7-4780-a716-2d52865b7793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cefd48a8b4437930deda2e5e1022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:05Z,use_quota=True,user_id='75efb95ac63548caac60c20f96584345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2092e60-2471-48de-b2b6-ee4c5c707f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2092e60-2471-48de-b2b6-ee4c5c707f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea77198-2a1b-49dd-afd4-7f2931c1f319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea77198-2a1b-49dd-afd4-7f2931c1f319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dae7390-8fe7-4780-a716-2d52865b7793', 'volume_name': 'volume-1dae7390-8fe7-4780-a716-2d52865b7793', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdc0f06-1cec-4476-9b68-b8afbfab57a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdc0f06-1cec-4476-9b68-b8afbfab57a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9572ffc-31de-4a4d-9f7b-9d7e36fef23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:05 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume 1dae7390-8fe7-4780-a716-2d52865b7793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dae7390-8fe7-4780-a716-2d52865b7793', 'volume_size': 1}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Acquiring lock "cinder-d0d5bf92-012f-4d15-bb51-7b8de0921a23-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Lock "cinder-d0d5bf92-012f-4d15-bb51-7b8de0921a23-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Acquiring lock "cinder-quobyte-d0d5bf92-012f-4d15-bb51-7b8de0921a23" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Lock "cinder-quobyte-d0d5bf92-012f-4d15-bb51-7b8de0921a23" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:05 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2" returned: 0 in 0.496s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.786s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1837546895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f086416-e0e0-482e-b0fc-aea8e154c9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6323267ee4f940c18ea5cdb44781597d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:04Z,use_quota=True,user_id='751cbf3a6bb04e5189feb4db1a69ddda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Creating volume 3f086416-e0e0-482e-b0fc-aea8e154c9ee {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:05 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10662b7-9e9f-498f-8479-562715ad635e]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:05 devstack sudo[98962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee 1073741824
Sep 16 08:46:05 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462420e4-9f82-4c4b-8ee5-3a52091c9952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64910275-6d14-4f0d-97a9-2d2cdc8efaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:05 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2 (62bc9d96-bdad-46b8-8e59-640d47ad73c2): created successfully
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64910275-6d14-4f0d-97a9-2d2cdc8efaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Flow 'volume_create_manager' (438d99b6-a9eb-470d-99c4-f2f2dd70a693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:05 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-51ecf808-b985-4db4-b74a-0ae1d232cfc4 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created volume successfully.
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Flow 'volume_create_manager' (9ad0c8c9-41f5-40ce-8caa-d663d00a54c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8243841-ec07-42ae-aa08-fc84915a0c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:05 devstack sudo[98963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23
Sep 16 08:46:05 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8243841-ec07-42ae-aa08-fc84915a0c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-965571568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60af3c64-87a6-4b9d-9064-9c1f3d520934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cefd48a8b4437930deda2e5e1022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:05Z,use_quota=True,user_id='75efb95ac63548caac60c20f96584345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee2d23d-b2aa-4a5b-9a44-ecce51b9fdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee2d23d-b2aa-4a5b-9a44-ecce51b9fdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb8596b-6269-4013-aba1-cbe1342a9042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb8596b-6269-4013-aba1-cbe1342a9042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60af3c64-87a6-4b9d-9064-9c1f3d520934', 'volume_name': 'volume-60af3c64-87a6-4b9d-9064-9c1f3d520934', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795244b4-0c44-45c8-a9eb-d3c160c96e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795244b4-0c44-45c8-a9eb-d3c160c96e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c039dc-4d77-45fe-af8d-34f3340db260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:05 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume 60af3c64-87a6-4b9d-9064-9c1f3d520934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60af3c64-87a6-4b9d-9064-9c1f3d520934', 'volume_size': 1}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:05 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee 1073741824" returned: 0 in 0.544s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:06 devstack sudo[98973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee
Sep 16 08:46:06 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:06 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23" returned: 0 in 0.639s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:06 devstack sudo[98975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23
Sep 16 08:46:06 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Flow 'volume_create_manager' (ed617f60-6592-4c4e-989d-3cd4d543756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f294290-0bf9-4b5b-93d9-cf28d6569bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f294290-0bf9-4b5b-93d9-cf28d6569bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193482330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e78d1b-f8b2-4548-bf0e-eb4d779afb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cefd48a8b4437930deda2e5e1022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:06Z,use_quota=True,user_id='75efb95ac63548caac60c20f96584345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1947f254-5481-4ea1-8efc-600ef4391a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1947f254-5481-4ea1-8efc-600ef4391a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc6464e-db8e-4ce7-b0e0-e60070cff45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc6464e-db8e-4ce7-b0e0-e60070cff45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e78d1b-f8b2-4548-bf0e-eb4d779afb18', 'volume_name': 'volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b6e150-8df0-43d7-ac58-7469b05aca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b6e150-8df0-43d7-ac58-7469b05aca93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652cbf3f-bf71-4879-b82e-4a201e177b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:06 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume 96e78d1b-f8b2-4548-bf0e-eb4d779afb18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18', 'volume_size': 1}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:06 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee" returned: 0 in 0.305s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.497s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-306935144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cefd48a8b4437930deda2e5e1022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:04Z,use_quota=True,user_id='75efb95ac63548caac60c20f96584345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Creating volume f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:06 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174e75c4-7d56-4f19-a39e-c17a6db54117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:06 devstack sudo[98979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21 1073741824
Sep 16 08:46:06 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453e5263-bdaf-485d-84b8-551ee4fc7078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:06 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Volume volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee (3f086416-e0e0-482e-b0fc-aea8e154c9ee): created successfully
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453e5263-bdaf-485d-84b8-551ee4fc7078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Flow 'volume_create_manager' (13fd1683-97e3-4ac8-802c-d85ecd069423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:06 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-408bfc12-3b7e-4a65-84fe-dbd08bf123d0 tempest-VolumesServicesTestJSON-337396524 None] Created volume successfully.
Sep 16 08:46:06 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d0d5bf92-012f-4d15-bb51-7b8de0921a23" returned: 0 in 0.393s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Lock "cinder-quobyte-d0d5bf92-012f-4d15-bb51-7b8de0921a23" released by "delete_volume" :: held 1.127s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Created reservations ['614b723c-30a5-43d4-acdf-4c2c81f81a41', '052eddf4-e6d0-4e50-9df4-04497eb6b831', '7dc93797-4d84-40fa-a331-0dc1275367ae', '28bccd1a-4bcd-415a-bdc9-68baa5b26244'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:06 devstack sudo[98985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:06 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:06 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21 1073741824" returned: 0 in 0.509s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:06 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.293s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:06 devstack sudo[98989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21
Sep 16 08:46:06 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:06 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Deleted volume successfully.
Sep 16 08:46:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-93553e8b-626e-446d-a902-4b9ccd5c033f tempest-VolumesActionsTest-1116291258 None] Lock "cinder-d0d5bf92-012f-4d15-bb51-7b8de0921a23-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:07 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21" returned: 0 in 0.278s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.932s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1353496528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dae7390-8fe7-4780-a716-2d52865b7793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cefd48a8b4437930deda2e5e1022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:05Z,use_quota=True,user_id='75efb95ac63548caac60c20f96584345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Creating volume 1dae7390-8fe7-4780-a716-2d52865b7793 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:07 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1dae7390-8fe7-4780-a716-2d52865b7793 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2ee286-2788-4482-9494-42290c1b08ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:07 devstack sudo[98992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1dae7390-8fe7-4780-a716-2d52865b7793 1073741824
Sep 16 08:46:07 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a28a15-5548-49df-b97b-24ab6b69cea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:07 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21 (f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21): created successfully
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a28a15-5548-49df-b97b-24ab6b69cea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Flow 'volume_create_manager' (2c3a92e9-cf90-426c-b7f0-3ebeadd7ae8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:07 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-65f94bca-6535-4162-bda6-974d05c9303d tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created volume successfully.
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Acquiring lock "cinder-3f086416-e0e0-482e-b0fc-aea8e154c9ee-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Lock "cinder-3f086416-e0e0-482e-b0fc-aea8e154c9ee-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Acquiring lock "cinder-quobyte-3f086416-e0e0-482e-b0fc-aea8e154c9ee" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Lock "cinder-quobyte-3f086416-e0e0-482e-b0fc-aea8e154c9ee" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f18ae53-8362-437b-af88-013f9ab9274a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:07 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1dae7390-8fe7-4780-a716-2d52865b7793 1073741824" returned: 0 in 0.645s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1dae7390-8fe7-4780-a716-2d52865b7793 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:07 devstack sudo[98999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee
Sep 16 08:46:07 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:07 devstack sudo[99000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1dae7390-8fe7-4780-a716-2d52865b7793
Sep 16 08:46:07 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:08 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1dae7390-8fe7-4780-a716-2d52865b7793" returned: 0 in 0.320s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.502s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-965571568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60af3c64-87a6-4b9d-9064-9c1f3d520934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cefd48a8b4437930deda2e5e1022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:05Z,use_quota=True,user_id='75efb95ac63548caac60c20f96584345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Creating volume 60af3c64-87a6-4b9d-9064-9c1f3d520934 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:08 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-60af3c64-87a6-4b9d-9064-9c1f3d520934 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:08 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee" returned: 0 in 0.485s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:08 devstack sudo[99007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-60af3c64-87a6-4b9d-9064-9c1f3d520934 1073741824
Sep 16 08:46:08 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9572ffc-31de-4a4d-9f7b-9d7e36fef23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dae7390-8fe7-4780-a716-2d52865b7793', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:08 devstack sudo[99008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225d863d-d93b-48be-9124-aa415c0a6edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:08 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:08 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume volume-1dae7390-8fe7-4780-a716-2d52865b7793 (1dae7390-8fe7-4780-a716-2d52865b7793): created successfully
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225d863d-d93b-48be-9124-aa415c0a6edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Flow 'volume_create_manager' (636ed2d1-d082-4523-9f71-defbbcc6d5cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Flow 'volume_create_manager' (1552603c-c08f-44af-a510-55feb9e924fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03eae5b1-649c-4793-a1c7-b832a3ae3e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:08 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-46708724-4057-426f-b7bf-5dad7bcf64b0 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created volume successfully.
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03eae5b1-649c-4793-a1c7-b832a3ae3e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-39949396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f7293d-544c-4468-b70c-dd12d1e9eab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611d3d1996b476088abd9037669dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:08Z,use_quota=True,user_id='2d21d91b95164eab965d9280305b41be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10869c71-d1f3-414d-8e46-30ba44b24d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10869c71-d1f3-414d-8e46-30ba44b24d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9e0b0c-acc7-450f-a785-3b54b1f8fe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9e0b0c-acc7-450f-a785-3b54b1f8fe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f7293d-544c-4468-b70c-dd12d1e9eab3', 'volume_name': 'volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf08e69a-941c-430a-97ae-d1a6a718fbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf08e69a-941c-430a-97ae-d1a6a718fbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3e882c-0a47-475b-b419-9732f4abfc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:08 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Volume d6f7293d-544c-4468-b70c-dd12d1e9eab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3', 'volume_size': 1}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:08 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3f086416-e0e0-482e-b0fc-aea8e154c9ee" returned: 0 in 0.388s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Lock "cinder-quobyte-3f086416-e0e0-482e-b0fc-aea8e154c9ee" released by "delete_volume" :: held 0.928s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Created reservations ['a5c0d126-12c3-4723-a221-25b94e5f0587', '52af43f9-b7be-4402-8d7b-bbbd85718490', '5c7423a3-c771-49de-9b4d-924cd7300f92', '7aceec7e-7fbd-47c2-aa4c-b0171b34c5e5'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:08 devstack sudo[99018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:08 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:08 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-60af3c64-87a6-4b9d-9064-9c1f3d520934 1073741824" returned: 0 in 0.640s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-60af3c64-87a6-4b9d-9064-9c1f3d520934 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:08 devstack sudo[99020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-60af3c64-87a6-4b9d-9064-9c1f3d520934
Sep 16 08:46:08 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:09 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.267s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:09 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Deleted volume successfully.
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eaf4cfda-ede8-463b-aeb1-8400beeec1b0 tempest-VolumesServicesTestJSON-337396524 None] Lock "cinder-3f086416-e0e0-482e-b0fc-aea8e154c9ee-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:09 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-60af3c64-87a6-4b9d-9064-9c1f3d520934" returned: 0 in 0.285s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.978s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193482330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e78d1b-f8b2-4548-bf0e-eb4d779afb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cefd48a8b4437930deda2e5e1022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:06Z,use_quota=True,user_id='75efb95ac63548caac60c20f96584345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Creating volume 96e78d1b-f8b2-4548-bf0e-eb4d779afb18 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:09 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:09 devstack sudo[99024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18 1073741824
Sep 16 08:46:09 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c039dc-4d77-45fe-af8d-34f3340db260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60af3c64-87a6-4b9d-9064-9c1f3d520934', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388cb132-0f47-4816-90a3-859c5cc13bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:09 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume volume-60af3c64-87a6-4b9d-9064-9c1f3d520934 (60af3c64-87a6-4b9d-9064-9c1f3d520934): created successfully
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388cb132-0f47-4816-90a3-859c5cc13bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Flow 'volume_create_manager' (9ad0c8c9-41f5-40ce-8caa-d663d00a54c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:09 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a4221a03-d2a2-49d8-a3df-37c66b90a711 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created volume successfully.
Sep 16 08:46:09 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18 1073741824" returned: 0 in 0.525s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:09 devstack sudo[99030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18
Sep 16 08:46:09 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:10 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18" returned: 0 in 0.275s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.590s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-39949396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f7293d-544c-4468-b70c-dd12d1e9eab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e611d3d1996b476088abd9037669dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:08Z,use_quota=True,user_id='2d21d91b95164eab965d9280305b41be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Creating volume d6f7293d-544c-4468-b70c-dd12d1e9eab3 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:10 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652cbf3f-bf71-4879-b82e-4a201e177b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:10 devstack sudo[99033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3 1073741824
Sep 16 08:46:10 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fcef85-6d09-4453-b051-b684957423a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:10 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Volume volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18 (96e78d1b-f8b2-4548-bf0e-eb4d779afb18): created successfully
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fcef85-6d09-4453-b051-b684957423a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Flow 'volume_create_manager' (ed617f60-6592-4c4e-989d-3cd4d543756a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:10 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4667f172-d07c-44e6-aaef-e6430390540f tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created volume successfully.
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-96e78d1b-f8b2-4548-bf0e-eb4d779afb18-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-96e78d1b-f8b2-4548-bf0e-eb4d779afb18-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-quobyte-96e78d1b-f8b2-4548-bf0e-eb4d779afb18" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-96e78d1b-f8b2-4548-bf0e-eb4d779afb18" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c781ead1-f45d-4eb5-a272-dbc0c7edebca]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:10 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3 1073741824" returned: 0 in 0.690s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:10 devstack sudo[99040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3
Sep 16 08:46:10 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:10 devstack sudo[99039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18
Sep 16 08:46:10 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:11 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3" returned: 0 in 0.282s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3e882c-0a47-475b-b419-9732f4abfc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f621c6-87b2-455c-9086-eba65ef53816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:11 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Volume volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3 (d6f7293d-544c-4468-b70c-dd12d1e9eab3): created successfully
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f621c6-87b2-455c-9086-eba65ef53816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Flow 'volume_create_manager' (1552603c-c08f-44af-a510-55feb9e924fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:11 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-41e577c1-ea27-45ae-a4e2-0e1e67b8452d tempest-VolumesActionsTest-881037041 None] Created volume successfully.
Sep 16 08:46:11 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18" returned: 0 in 0.491s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:11 devstack sudo[99047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18
Sep 16 08:46:11 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:11 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-96e78d1b-f8b2-4548-bf0e-eb4d779afb18" returned: 0 in 0.351s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-96e78d1b-f8b2-4548-bf0e-eb4d779afb18" released by "delete_volume" :: held 0.903s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created reservations ['0cc4e506-71a1-48ab-b7f1-80f00f4f7f88', '11aede9e-9ddc-4f06-abce-e70ac6561c2c', 'a4305196-8baf-48d3-8325-9db892fde0cf', '06c8e7f2-b439-4bb8-9ba0-9998c0ffd39d'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-60af3c64-87a6-4b9d-9064-9c1f3d520934-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:11 devstack sudo[99052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:11 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-60af3c64-87a6-4b9d-9064-9c1f3d520934-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-quobyte-60af3c64-87a6-4b9d-9064-9c1f3d520934" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-60af3c64-87a6-4b9d-9064-9c1f3d520934" acquired by "delete_volume" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d134a4a-45d7-490b-9542-5207020b1826]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-60af3c64-87a6-4b9d-9064-9c1f3d520934 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:12 devstack sudo[99054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-60af3c64-87a6-4b9d-9064-9c1f3d520934
Sep 16 08:46:12 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:12 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.457s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:12 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Deleted volume successfully.
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b2a4c2b5-9f08-4a49-9914-a8bec6def169 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-96e78d1b-f8b2-4548-bf0e-eb4d779afb18-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Acquiring lock "cinder-d6f7293d-544c-4468-b70c-dd12d1e9eab3-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Lock "cinder-d6f7293d-544c-4468-b70c-dd12d1e9eab3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Acquiring lock "cinder-quobyte-d6f7293d-544c-4468-b70c-dd12d1e9eab3" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Lock "cinder-quobyte-d6f7293d-544c-4468-b70c-dd12d1e9eab3" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34aede6-6dfe-4322-9dc2-f6a84a3ede16]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:12 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:12 devstack sudo[99057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3
Sep 16 08:46:12 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-60af3c64-87a6-4b9d-9064-9c1f3d520934" returned: 0 in 0.633s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-60af3c64-87a6-4b9d-9064-9c1f3d520934 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:12 devstack sudo[99062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:12 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:12 devstack sudo[99063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-60af3c64-87a6-4b9d-9064-9c1f3d520934
Sep 16 08:46:12 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:13 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-60af3c64-87a6-4b9d-9064-9c1f3d520934" returned: 0 in 0.397s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-60af3c64-87a6-4b9d-9064-9c1f3d520934" released by "delete_volume" :: held 1.114s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:13 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3" returned: 0 in 0.667s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created reservations ['b7767fff-2196-4939-9e50-459513407de3', '8c4798c8-14e5-43e8-960c-3472d7dacbf7', 'a9f2746f-e7c0-4fca-8802-87935f015af2', 'edc73727-539f-4204-86bc-7bda852ac01e'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:13 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.550s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:13 devstack sudo[99071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3
Sep 16 08:46:13 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:13 devstack sudo[99073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:13 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:13 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d6f7293d-544c-4468-b70c-dd12d1e9eab3" returned: 0 in 0.367s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Lock "cinder-quobyte-d6f7293d-544c-4468-b70c-dd12d1e9eab3" released by "delete_volume" :: held 1.099s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Created reservations ['86022a9e-df73-4d3e-9d7c-0c314837d112', 'f1c89cd7-1081-46f7-ae5e-7d2de3d09bc9', '75023009-c119-4466-99a8-dced42e72fec', '34b11f44-200e-498d-80ed-46dce516d9af'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:13 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.315s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:13 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Deleted volume successfully.
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-30015340-da73-4bf7-a35f-b5b131f79e1a tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-60af3c64-87a6-4b9d-9064-9c1f3d520934-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:13 devstack sudo[99077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:13 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:13 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.256s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:13 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Deleted volume successfully.
Sep 16 08:46:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-55aad50b-c5d1-4b48-a335-c88ad1d315b4 tempest-VolumesActionsTest-881037041 None] Lock "cinder-d6f7293d-544c-4468-b70c-dd12d1e9eab3-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-1dae7390-8fe7-4780-a716-2d52865b7793-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-1dae7390-8fe7-4780-a716-2d52865b7793-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:14 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=160,cinder:INSERT=44,cinder:UPDATE=190,cinder:DELETE=14 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:46:14 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=205,cinder:SELECT=158,cinder:INSERT=50,cinder:DELETE=17 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:46:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-quobyte-1dae7390-8fe7-4780-a716-2d52865b7793" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-1dae7390-8fe7-4780-a716-2d52865b7793" acquired by "delete_volume" :: waited 0.031s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:14 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e5e781-81ab-42f0-af8f-4ab71453679d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1dae7390-8fe7-4780-a716-2d52865b7793 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:14 devstack sudo[99080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1dae7390-8fe7-4780-a716-2d52865b7793
Sep 16 08:46:14 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:14 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1dae7390-8fe7-4780-a716-2d52865b7793" returned: 0 in 0.418s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1dae7390-8fe7-4780-a716-2d52865b7793 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:14 devstack sudo[99086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1dae7390-8fe7-4780-a716-2d52865b7793
Sep 16 08:46:14 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:15 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1dae7390-8fe7-4780-a716-2d52865b7793" returned: 0 in 0.360s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-1dae7390-8fe7-4780-a716-2d52865b7793" released by "delete_volume" :: held 0.847s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created reservations ['c130f4f2-4f12-4b16-9c45-57798ade7ed7', '748aad56-5b84-47e5-b318-13af046b221a', '91c0241a-b717-4919-bc26-771a452081ad', '92d22cf2-c5df-468a-8c39-2c2542a597fd'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:15 devstack sudo[99090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:15 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-quobyte-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21" acquired by "delete_volume" :: waited 0.037s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:15 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.362s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a158ffe5-04c1-4434-b99b-d9174a4f4242]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:15 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Deleted volume successfully.
Sep 16 08:46:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9257aba0-ab8c-4bed-8f9f-c1820c508835 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-1dae7390-8fe7-4780-a716-2d52865b7793-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:15 devstack sudo[99093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21
Sep 16 08:46:15 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:16 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21" returned: 0 in 0.487s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:16 devstack sudo[99098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21
Sep 16 08:46:16 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:16 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21" returned: 0 in 0.382s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21" released by "delete_volume" :: held 0.950s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:16 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created reservations ['981b71ec-d9c6-472d-816e-f35d7e53d168', '50faabd4-6ff0-462f-8197-2c5bd0d170da', '17aba205-b509-4528-8099-39765d97d7df', 'b5c1af15-9dce-4685-8b1e-f5b067e6dde6'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:16 devstack sudo[99102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:16 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:17 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.322s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:17 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Deleted volume successfully.
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9f416b12-1bc0-4d7f-8270-86bbb52077a8 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-f658b041-c8b7-4aef-a2f6-9a6a1b9d5e21-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Flow 'volume_create_manager' (5d3584af-83e5-4daf-978c-27eb4ff6056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79894303-0f52-4d39-8b6e-62654002f6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79894303-0f52-4d39-8b6e-62654002f6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-221971832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65148e9-9975-445f-8b91-eeade361a7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d277158897844a3b9e37051c2c8e2423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:18Z,use_quota=True,user_id='266414e979cd4faaae95b7f8a30adced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4c1104-b616-4d48-b573-a9a34d119900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4c1104-b616-4d48-b573-a9a34d119900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b32c31-ea10-486b-b0cc-5aa097002580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b32c31-ea10-486b-b0cc-5aa097002580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f65148e9-9975-445f-8b91-eeade361a7a6', 'volume_name': 'volume-f65148e9-9975-445f-8b91-eeade361a7a6', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567f8f39-322d-4d83-863b-c9c618253aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567f8f39-322d-4d83-863b-c9c618253aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e35e03-38b7-411b-8a8d-c7809180320f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:17 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Volume f65148e9-9975-445f-8b91-eeade361a7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f65148e9-9975-445f-8b91-eeade361a7a6', 'volume_size': 1}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-221971832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65148e9-9975-445f-8b91-eeade361a7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d277158897844a3b9e37051c2c8e2423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:18Z,use_quota=True,user_id='266414e979cd4faaae95b7f8a30adced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Creating volume f65148e9-9975-445f-8b91-eeade361a7a6 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:17 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f65148e9-9975-445f-8b91-eeade361a7a6 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-62bc9d96-bdad-46b8-8e59-640d47ad73c2-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:18 devstack sudo[99105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f65148e9-9975-445f-8b91-eeade361a7a6 1073741824
Sep 16 08:46:18 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-62bc9d96-bdad-46b8-8e59-640d47ad73c2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-quobyte-62bc9d96-bdad-46b8-8e59-640d47ad73c2" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-62bc9d96-bdad-46b8-8e59-640d47ad73c2" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:18 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cb8d0d-58a8-4b85-9b91-4d20838d98e9]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:18 devstack sudo[99107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2
Sep 16 08:46:18 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:18 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f65148e9-9975-445f-8b91-eeade361a7a6 1073741824" returned: 0 in 0.546s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f65148e9-9975-445f-8b91-eeade361a7a6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:18 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2" returned: 0 in 0.468s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:18 devstack sudo[99116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f65148e9-9975-445f-8b91-eeade361a7a6
Sep 16 08:46:18 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:18 devstack sudo[99117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2
Sep 16 08:46:18 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:18 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-62bc9d96-bdad-46b8-8e59-640d47ad73c2" returned: 0 in 0.382s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-62bc9d96-bdad-46b8-8e59-640d47ad73c2" released by "delete_volume" :: held 0.918s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:19 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f65148e9-9975-445f-8b91-eeade361a7a6" returned: 0 in 0.445s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e35e03-38b7-411b-8a8d-c7809180320f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f65148e9-9975-445f-8b91-eeade361a7a6', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3000928-4aad-4170-a017-cbbddc57c47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:19 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Volume volume-f65148e9-9975-445f-8b91-eeade361a7a6 (f65148e9-9975-445f-8b91-eeade361a7a6): created successfully
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3000928-4aad-4170-a017-cbbddc57c47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Flow 'volume_create_manager' (5d3584af-83e5-4daf-978c-27eb4ff6056b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:19 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-14422f8c-f234-4505-9e77-65ece0d3bc42 tempest-VolumesListAdminTestJSON-1673442756 None] Created volume successfully.
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created reservations ['e741c67c-c64c-4a8a-95ca-0ef81671939c', '4a8ed280-d948-45c0-93f0-d1ac22d42fc2', 'c6007aa1-af31-4b8c-ac85-267391cc37ff', '90f4f65b-33e4-4159-9884-94e10ac59d28'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:19 devstack sudo[99122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:19 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Flow 'volume_create_manager' (d81d2b79-348c-44af-9364-694c31bb6a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ad9825-5153-445a-8a09-d0bc108f07c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ad9825-5153-445a-8a09-d0bc108f07c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1187740284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5befed6-0a5a-4474-81ab-7a885d014c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70804a9e14a0405bbf42270df7c2cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:19Z,use_quota=True,user_id='8a7b66e02c8b4e37bfc2a3c93d796a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b815fe76-9896-4e53-9aa9-8147b3c7e996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b815fe76-9896-4e53-9aa9-8147b3c7e996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6797419b-e5de-46f5-bcbe-871ddb4305e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6797419b-e5de-46f5-bcbe-871ddb4305e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5befed6-0a5a-4474-81ab-7a885d014c87', 'volume_name': 'volume-e5befed6-0a5a-4474-81ab-7a885d014c87', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd57060-3ed8-4846-bc9a-8525d37b530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd57060-3ed8-4846-bc9a-8525d37b530b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0488e4ec-d990-4366-9782-8202c4894556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:19 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume e5befed6-0a5a-4474-81ab-7a885d014c87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5befed6-0a5a-4474-81ab-7a885d014c87', 'volume_size': 1}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1187740284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5befed6-0a5a-4474-81ab-7a885d014c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70804a9e14a0405bbf42270df7c2cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:19Z,use_quota=True,user_id='8a7b66e02c8b4e37bfc2a3c93d796a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Creating volume e5befed6-0a5a-4474-81ab-7a885d014c87 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:19 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e5befed6-0a5a-4474-81ab-7a885d014c87 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:19 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.303s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:19 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Deleted volume successfully.
Sep 16 08:46:19 devstack sudo[99125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e5befed6-0a5a-4474-81ab-7a885d014c87 1073741824
Sep 16 08:46:19 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2e6b6b5e-ea5b-4c70-a11d-9f8400a606cd tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-62bc9d96-bdad-46b8-8e59-640d47ad73c2-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:20 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e5befed6-0a5a-4474-81ab-7a885d014c87 1073741824" returned: 0 in 0.570s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e5befed6-0a5a-4474-81ab-7a885d014c87 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:20 devstack sudo[99132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e5befed6-0a5a-4474-81ab-7a885d014c87
Sep 16 08:46:20 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-26a89961-9ae8-4c54-b264-d685ff9dd711-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-26a89961-9ae8-4c54-b264-d685ff9dd711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-quobyte-908c3702-2c76-4a64-b438-70ab444c7854" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-908c3702-2c76-4a64-b438-70ab444c7854" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-quobyte-26a89961-9ae8-4c54-b264-d685ff9dd711" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-26a89961-9ae8-4c54-b264-d685ff9dd711" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Deleting offline snapshot 26a89961-9ae8-4c54-b264-d685ff9dd711 of volume 908c3702-2c76-4a64-b438-70ab444c7854 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] snapshot_file for this snap is: volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b424637-a14c-468e-88d7-d5e2709a589b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:20 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e5befed6-0a5a-4474-81ab-7a885d014c87" returned: 0 in 0.434s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:20 devstack sudo[99134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711
Sep 16 08:46:20 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0488e4ec-d990-4366-9782-8202c4894556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5befed6-0a5a-4474-81ab-7a885d014c87', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7860760-4920-460c-93b8-317c3c6dbdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:20 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume volume-e5befed6-0a5a-4474-81ab-7a885d014c87 (e5befed6-0a5a-4474-81ab-7a885d014c87): created successfully
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7860760-4920-460c-93b8-317c3c6dbdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Flow 'volume_create_manager' (d81d2b79-348c-44af-9364-694c31bb6a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:20 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-07e6de3c-b997-43fa-9e94-c03a024e03ad tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Created volume successfully.
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Flow 'volume_create_manager' (a4bee821-f9e2-47c1-89ad-234205af68c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a45813-8b65-48a4-a978-7d95c4ad6ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a45813-8b65-48a4-a978-7d95c4ad6ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1885052005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aab825e-064c-4690-818e-80593c1fc7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d277158897844a3b9e37051c2c8e2423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:21Z,use_quota=True,user_id='266414e979cd4faaae95b7f8a30adced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f27fb14-12c4-4fb6-90bb-40334a024614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f27fb14-12c4-4fb6-90bb-40334a024614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7093a550-a537-4a3e-8f59-91fc8d8c4385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7093a550-a537-4a3e-8f59-91fc8d8c4385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aab825e-064c-4690-818e-80593c1fc7d0', 'volume_name': 'volume-9aab825e-064c-4690-818e-80593c1fc7d0', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bb4d52-52eb-4caf-b94c-a64bc49d4308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bb4d52-52eb-4caf-b94c-a64bc49d4308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f72aad-9761-4142-b719-38f2e6a21a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:20 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Volume 9aab825e-064c-4690-818e-80593c1fc7d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aab825e-064c-4690-818e-80593c1fc7d0', 'volume_size': 1}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1885052005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aab825e-064c-4690-818e-80593c1fc7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d277158897844a3b9e37051c2c8e2423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:21Z,use_quota=True,user_id='266414e979cd4faaae95b7f8a30adced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Creating volume 9aab825e-064c-4690-818e-80593c1fc7d0 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:20 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9aab825e-064c-4690-818e-80593c1fc7d0 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:20 devstack sudo[99137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9aab825e-064c-4690-818e-80593c1fc7d0 1073741824
Sep 16 08:46:20 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:20 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711" returned: 0 in 0.435s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-908c3702-2c76-4a64-b438-70ab444c7854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[afef6d71-2798-4375-acb9-3c8c9c06157a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:21 devstack sudo[99143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854
Sep 16 08:46:21 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:21 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9aab825e-064c-4690-818e-80593c1fc7d0 1073741824" returned: 0 in 0.539s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:21 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854" returned: 0 in 0.413s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9aab825e-064c-4690-818e-80593c1fc7d0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:21 devstack sudo[99153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711
Sep 16 08:46:21 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:21 devstack sudo[99154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9aab825e-064c-4690-818e-80593c1fc7d0
Sep 16 08:46:21 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:21 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9aab825e-064c-4690-818e-80593c1fc7d0" returned: 0 in 0.368s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f72aad-9761-4142-b719-38f2e6a21a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aab825e-064c-4690-818e-80593c1fc7d0', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05dd31ba-62b0-4943-9607-e52f1220a97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:21 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Volume volume-9aab825e-064c-4690-818e-80593c1fc7d0 (9aab825e-064c-4690-818e-80593c1fc7d0): created successfully
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05dd31ba-62b0-4943-9607-e52f1220a97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Flow 'volume_create_manager' (a4bee821-f9e2-47c1-89ad-234205af68c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:21 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:21 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5952a8db-fae1-4c63-8d75-1affc03202dd tempest-VolumesListAdminTestJSON-1673442756 None] Created volume successfully.
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711" returned: 0 in 0.496s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:21 devstack sudo[99162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711
Sep 16 08:46:21 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Flow 'volume_create_manager' (7d0b7df6-d00f-43b5-b280-971c97870df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e5d275-aa25-418b-85b4-c3934e1fef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e5d275-aa25-418b-85b4-c3934e1fef9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-340452843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98edad98-7300-44cf-a7ca-5a7b954f98c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70804a9e14a0405bbf42270df7c2cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:22Z,use_quota=True,user_id='8a7b66e02c8b4e37bfc2a3c93d796a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153c2720-75cc-4f4e-9c53-61cae78c594e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153c2720-75cc-4f4e-9c53-61cae78c594e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f737a8-820b-41e4-b8a4-331b5239d4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f737a8-820b-41e4-b8a4-331b5239d4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98edad98-7300-44cf-a7ca-5a7b954f98c7', 'volume_name': 'volume-98edad98-7300-44cf-a7ca-5a7b954f98c7', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40dd031-6aff-4a47-93f8-8889776f519e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40dd031-6aff-4a47-93f8-8889776f519e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ee2c2c-a4ef-4060-9582-18bf07884d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume 98edad98-7300-44cf-a7ca-5a7b954f98c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98edad98-7300-44cf-a7ca-5a7b954f98c7', 'volume_size': 1}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-340452843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98edad98-7300-44cf-a7ca-5a7b954f98c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70804a9e14a0405bbf42270df7c2cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:22Z,use_quota=True,user_id='8a7b66e02c8b4e37bfc2a3c93d796a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Creating volume 98edad98-7300-44cf-a7ca-5a7b954f98c7 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:22 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:22 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-98edad98-7300-44cf-a7ca-5a7b954f98c7 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854.26a89961-9ae8-4c54-b264-d685ff9dd711" returned: 0 in 0.415s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:22 devstack sudo[99165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-98edad98-7300-44cf-a7ca-5a7b954f98c7 1073741824
Sep 16 08:46:22 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-26a89961-9ae8-4c54-b264-d685ff9dd711" released by "_delete_snapshot" :: held 2.011s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-908c3702-2c76-4a64-b438-70ab444c7854" released by "delete_snapshot" :: held 2.057s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created reservations ['60f9ecdb-7c15-4818-b5b0-91bff2f40681', '5c8d1087-12a2-4e41-994e-60f8d6e1e4ca', 'bacf12eb-fe24-48a7-8035-828a755f8db5', '2ab5b277-0a77-4758-b9b7-e2d35bda4ba5'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Flow 'volume_create_manager' (78499aca-3607-4bf8-bf1d-29cd44ba8192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f7548f-7800-4e83-8a02-69a1d70fd449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f7548f-7800-4e83-8a02-69a1d70fd449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1466856513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb51d4a-05e6-4ed7-a653-c2a8d20c772b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70804a9e14a0405bbf42270df7c2cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:22Z,use_quota=True,user_id='8a7b66e02c8b4e37bfc2a3c93d796a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5e9e95-fb43-4885-9c73-297844144a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5e9e95-fb43-4885-9c73-297844144a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d319db21-197e-4588-9940-9ae0cb92e81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d319db21-197e-4588-9940-9ae0cb92e81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcb51d4a-05e6-4ed7-a653-c2a8d20c772b', 'volume_name': 'volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8daa26c-acde-452d-9f52-ce2d3bb5fe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8daa26c-acde-452d-9f52-ce2d3bb5fe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68afd6d9-3793-467d-a421-8dc66a6638fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume fcb51d4a-05e6-4ed7-a653-c2a8d20c772b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b', 'volume_size': 1}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:22 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Delete snapshot completed successfully.
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed9338f5-02aa-4ca2-a9cc-ad90a0306d66 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-26a89961-9ae8-4c54-b264-d685ff9dd711-delete_snapshot" released by "delete_snapshot" :: held 2.559s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:22 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Flow 'volume_create_manager' (43c41eaa-cc3a-448a-995a-3797d7f1bb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff65853a-fea3-4dea-9336-9b11ea082c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-98edad98-7300-44cf-a7ca-5a7b954f98c7 1073741824" returned: 0 in 0.738s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff65853a-fea3-4dea-9336-9b11ea082c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1917427465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7f1e7a-7670-4ade-9b6f-8994689f54dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70804a9e14a0405bbf42270df7c2cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:23Z,use_quota=True,user_id='8a7b66e02c8b4e37bfc2a3c93d796a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b4c654-d234-4729-8d89-d4dccf3fe23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b4c654-d234-4729-8d89-d4dccf3fe23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c05bcc4-29fe-4c3e-b1fb-879693d0cc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c05bcc4-29fe-4c3e-b1fb-879693d0cc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7f1e7a-7670-4ade-9b6f-8994689f54dc', 'volume_name': 'volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa414d8-43cc-4eb5-83ec-39d938a21c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa414d8-43cc-4eb5-83ec-39d938a21c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8ce28a-fd86-4232-8f77-de3d76245c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:23 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume 1f7f1e7a-7670-4ade-9b6f-8994689f54dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc', 'volume_size': 1}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-98edad98-7300-44cf-a7ca-5a7b954f98c7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:23 devstack sudo[99171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-98edad98-7300-44cf-a7ca-5a7b954f98c7
Sep 16 08:46:23 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:23 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-98edad98-7300-44cf-a7ca-5a7b954f98c7" returned: 0 in 0.360s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.655s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1466856513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb51d4a-05e6-4ed7-a653-c2a8d20c772b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70804a9e14a0405bbf42270df7c2cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:22Z,use_quota=True,user_id='8a7b66e02c8b4e37bfc2a3c93d796a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Creating volume fcb51d4a-05e6-4ed7-a653-c2a8d20c772b {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:23 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ee2c2c-a4ef-4060-9582-18bf07884d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98edad98-7300-44cf-a7ca-5a7b954f98c7', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed1446e-a0da-4e3f-bd9a-8faecfcc4295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:23 devstack sudo[99174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b 1073741824
Sep 16 08:46:23 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:23 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume volume-98edad98-7300-44cf-a7ca-5a7b954f98c7 (98edad98-7300-44cf-a7ca-5a7b954f98c7): created successfully
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed1446e-a0da-4e3f-bd9a-8faecfcc4295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Flow 'volume_create_manager' (7d0b7df6-d00f-43b5-b280-971c97870df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:23 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d873a424-d4c3-4058-a056-1485a1541dbc tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Created volume successfully.
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-908c3702-2c76-4a64-b438-70ab444c7854-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-908c3702-2c76-4a64-b438-70ab444c7854-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "cinder-quobyte-908c3702-2c76-4a64-b438-70ab444c7854" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-908c3702-2c76-4a64-b438-70ab444c7854" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a166a1a-f0f4-4ca3-907c-1afe49a4b44e]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Flow 'volume_create_manager' (6e6a7248-77be-435f-946a-be6cb50629de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657e8a1b-259e-4fe7-ac61-12a1dbc9b290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657e8a1b-259e-4fe7-ac61-12a1dbc9b290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1783388512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1f3cb3-4298-4976-9b36-7bc1ee2ade2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70804a9e14a0405bbf42270df7c2cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:24Z,use_quota=True,user_id='8a7b66e02c8b4e37bfc2a3c93d796a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a011e4-b32f-4d93-994e-cae630781db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a011e4-b32f-4d93-994e-cae630781db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b61362-07bf-4176-a707-38b6beddb55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b61362-07bf-4176-a707-38b6beddb55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db1f3cb3-4298-4976-9b36-7bc1ee2ade2b', 'volume_name': 'volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa14061b-8f24-4505-a052-7bda104b46fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa14061b-8f24-4505-a052-7bda104b46fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1965f3-a99b-43cb-9964-8fe04c02baf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:23 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume db1f3cb3-4298-4976-9b36-7bc1ee2ade2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b', 'volume_size': 1}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:23 devstack sudo[99178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854
Sep 16 08:46:23 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Flow 'volume_create_manager' (a6d7897e-85ca-4afb-8aeb-a0884efcaa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec1ec11-473f-40fe-b229-a94d2bd9db22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec1ec11-473f-40fe-b229-a94d2bd9db22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1236305139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b93cb4e-aabb-4e93-a5b4-1a818a3dd908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d277158897844a3b9e37051c2c8e2423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:24Z,use_quota=True,user_id='266414e979cd4faaae95b7f8a30adced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec882eb6-8b6c-4dcb-87ec-0144ff4561a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec882eb6-8b6c-4dcb-87ec-0144ff4561a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eec2bff-828c-414d-9a5c-8bd4d8638591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eec2bff-828c-414d-9a5c-8bd4d8638591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b93cb4e-aabb-4e93-a5b4-1a818a3dd908', 'volume_name': 'volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addb9c8e-828a-4a09-93b8-b4fd3e9def05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addb9c8e-828a-4a09-93b8-b4fd3e9def05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544bc778-2de2-4132-9523-ec5c497609be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:24 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Volume 6b93cb4e-aabb-4e93-a5b4-1a818a3dd908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908', 'volume_size': 1}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Flow 'volume_create_manager' (1de591a9-aa68-4a6f-a707-f5f81131ba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00279e6b-626f-45ec-8aba-03a709b47e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:24 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00279e6b-626f-45ec-8aba-03a709b47e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-856882858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66ab8ac-7162-4250-b428-17d60d5ea683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70804a9e14a0405bbf42270df7c2cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:24Z,use_quota=True,user_id='8a7b66e02c8b4e37bfc2a3c93d796a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4dd75f-0363-4f66-8bd0-3d32f97d50a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4dd75f-0363-4f66-8bd0-3d32f97d50a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1873d5-5da8-4e7a-ac3b-554308914f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1873d5-5da8-4e7a-ac3b-554308914f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f66ab8ac-7162-4250-b428-17d60d5ea683', 'volume_name': 'volume-f66ab8ac-7162-4250-b428-17d60d5ea683', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a39d35-bd4d-41c5-80af-54fce4018fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a39d35-bd4d-41c5-80af-54fce4018fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a129dd-2b54-46dc-806d-0680cd2f747b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:24 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume f66ab8ac-7162-4250-b428-17d60d5ea683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f66ab8ac-7162-4250-b428-17d60d5ea683', 'volume_size': 1}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b 1073741824" returned: 0 in 0.815s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:24 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854" returned: 0 in 0.450s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:24 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854
Sep 16 08:46:24 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:24 devstack sudo[99186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b
Sep 16 08:46:24 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:24 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b" returned: 0 in 0.309s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.604s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1917427465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7f1e7a-7670-4ade-9b6f-8994689f54dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70804a9e14a0405bbf42270df7c2cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:23Z,use_quota=True,user_id='8a7b66e02c8b4e37bfc2a3c93d796a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Creating volume 1f7f1e7a-7670-4ade-9b6f-8994689f54dc {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:24 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:24 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-908c3702-2c76-4a64-b438-70ab444c7854" returned: 0 in 0.386s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:24 devstack sudo[99190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc 1073741824
Sep 16 08:46:24 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-quobyte-908c3702-2c76-4a64-b438-70ab444c7854" released by "delete_volume" :: held 0.944s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68afd6d9-3793-467d-a421-8dc66a6638fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8233208-3adb-4e2e-b847-ef238416b010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:24 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b (fcb51d4a-05e6-4ed7-a653-c2a8d20c772b): created successfully
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8233208-3adb-4e2e-b847-ef238416b010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Flow 'volume_create_manager' (78499aca-3607-4bf8-bf1d-29cd44ba8192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:24 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5149dffd-dd44-4b0c-a05c-8da11c50ea7c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Created volume successfully.
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Created reservations ['db18bba6-8084-4985-a95a-363083f00ad3', 'dc5fe8df-a045-4091-9fec-892a5738adca', 'a9edb61b-0934-430e-9990-4051ed2af3ea', '314ca1c4-f69c-4e24-890c-f6e7608ff566'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:24 devstack sudo[99192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:24 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:25 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.301s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:25 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Deleted volume successfully.
Sep 16 08:46:25 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc 1073741824" returned: 0 in 0.521s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3f32d1e8-5302-4724-a3d5-df4cd8d390e1 tempest-CreateVolumesFromSnapshotTest-1794956959 None] Lock "cinder-908c3702-2c76-4a64-b438-70ab444c7854-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:25 devstack sudo[99199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc
Sep 16 08:46:25 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:25 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc" returned: 0 in 0.277s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.539s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1783388512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1f3cb3-4298-4976-9b36-7bc1ee2ade2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70804a9e14a0405bbf42270df7c2cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:24Z,use_quota=True,user_id='8a7b66e02c8b4e37bfc2a3c93d796a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Creating volume db1f3cb3-4298-4976-9b36-7bc1ee2ade2b {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:25 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8ce28a-fd86-4232-8f77-de3d76245c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:25 devstack sudo[99203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b 1073741824
Sep 16 08:46:25 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fddeddbd-b064-4c2b-a6b0-4d02c3adde04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:25 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc (1f7f1e7a-7670-4ade-9b6f-8994689f54dc): created successfully
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fddeddbd-b064-4c2b-a6b0-4d02c3adde04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Flow 'volume_create_manager' (43c41eaa-cc3a-448a-995a-3797d7f1bb47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:25 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-6c440203-30af-4050-ad2c-63b90c16b23e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Created volume successfully.
Sep 16 08:46:26 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b 1073741824" returned: 0 in 0.519s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:26 devstack sudo[99209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b
Sep 16 08:46:26 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:26 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b" returned: 0 in 0.279s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.231s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1236305139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b93cb4e-aabb-4e93-a5b4-1a818a3dd908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d277158897844a3b9e37051c2c8e2423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:24Z,use_quota=True,user_id='266414e979cd4faaae95b7f8a30adced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Creating volume 6b93cb4e-aabb-4e93-a5b4-1a818a3dd908 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:26 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1965f3-a99b-43cb-9964-8fe04c02baf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:26 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908 1073741824
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3743bf-dcc7-439e-ba8f-e6c28211bf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:26 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:26 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b (db1f3cb3-4298-4976-9b36-7bc1ee2ade2b): created successfully
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3743bf-dcc7-439e-ba8f-e6c28211bf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Flow 'volume_create_manager' (6e6a7248-77be-435f-946a-be6cb50629de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:26 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5cd9111e-c2f6-47a4-88f1-cc4c420e5749 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Created volume successfully.
Sep 16 08:46:26 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908 1073741824" returned: 0 in 0.549s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:26 devstack sudo[99218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908
Sep 16 08:46:26 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:27 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908" returned: 0 in 0.289s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-856882858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66ab8ac-7162-4250-b428-17d60d5ea683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70804a9e14a0405bbf42270df7c2cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:24Z,use_quota=True,user_id='8a7b66e02c8b4e37bfc2a3c93d796a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Creating volume f66ab8ac-7162-4250-b428-17d60d5ea683 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:27 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f66ab8ac-7162-4250-b428-17d60d5ea683 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544bc778-2de2-4132-9523-ec5c497609be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:27 devstack sudo[99221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f66ab8ac-7162-4250-b428-17d60d5ea683 1073741824
Sep 16 08:46:27 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e092fa19-38c5-437e-a2bc-566b96ca2747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:27 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Volume volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908 (6b93cb4e-aabb-4e93-a5b4-1a818a3dd908): created successfully
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e092fa19-38c5-437e-a2bc-566b96ca2747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Flow 'volume_create_manager' (a6d7897e-85ca-4afb-8aeb-a0884efcaa7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-dc60f844-609a-4a77-90e2-753d3ac9b830 tempest-VolumesListAdminTestJSON-1673442756 None] Created volume successfully.
Sep 16 08:46:27 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f66ab8ac-7162-4250-b428-17d60d5ea683 1073741824" returned: 0 in 0.550s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f66ab8ac-7162-4250-b428-17d60d5ea683 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:27 devstack sudo[99227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f66ab8ac-7162-4250-b428-17d60d5ea683
Sep 16 08:46:27 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:28 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f66ab8ac-7162-4250-b428-17d60d5ea683" returned: 0 in 0.276s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a129dd-2b54-46dc-806d-0680cd2f747b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f66ab8ac-7162-4250-b428-17d60d5ea683', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4781f03f-aae0-417a-baa8-ce38cf475dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:28 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Volume volume-f66ab8ac-7162-4250-b428-17d60d5ea683 (f66ab8ac-7162-4250-b428-17d60d5ea683): created successfully
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4781f03f-aae0-417a-baa8-ce38cf475dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Flow 'volume_create_manager' (1de591a9-aa68-4a6f-a707-f5f81131ba49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:28 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ac1b1be8-7330-4df7-be7a-f7b7cc715533 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Created volume successfully.
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "cinder-f66ab8ac-7162-4250-b428-17d60d5ea683-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-f66ab8ac-7162-4250-b428-17d60d5ea683-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "cinder-quobyte-f66ab8ac-7162-4250-b428-17d60d5ea683" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-quobyte-f66ab8ac-7162-4250-b428-17d60d5ea683" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f668e7d-7866-40f4-8eb8-81d713594af9]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f66ab8ac-7162-4250-b428-17d60d5ea683 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Flow 'volume_create_manager' (e636acd7-99e9-4178-90fe-797b893e0e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361cd979-b0ed-468a-bcc6-321b6c64704a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361cd979-b0ed-468a-bcc6-321b6c64704a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7604f7-eced-4558-a5af-a8dcca50a91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53652a3cc69f4884b6e28e582f4f39dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:29Z,use_quota=True,user_id='ff27dbf56cf846b39cb63e734812de9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:29 devstack sudo[99230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f66ab8ac-7162-4250-b428-17d60d5ea683
Sep 16 08:46:29 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b638543a-c5f7-4756-95a4-e2359b4441c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b638543a-c5f7-4756-95a4-e2359b4441c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f835125-306a-4d09-b276-8d979e212dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f835125-306a-4d09-b276-8d979e212dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd7604f7-eced-4558-a5af-a8dcca50a91a', 'volume_name': 'volume-fd7604f7-eced-4558-a5af-a8dcca50a91a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982ba084-e1ac-4df4-a0b7-97d3395cc6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982ba084-e1ac-4df4-a0b7-97d3395cc6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860cc0cc-592f-4fc7-8ed6-b26304e5efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:29 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Volume fd7604f7-eced-4558-a5af-a8dcca50a91a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd7604f7-eced-4558-a5af-a8dcca50a91a', 'volume_size': 1}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7604f7-eced-4558-a5af-a8dcca50a91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53652a3cc69f4884b6e28e582f4f39dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:29Z,use_quota=True,user_id='ff27dbf56cf846b39cb63e734812de9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Creating volume fd7604f7-eced-4558-a5af-a8dcca50a91a {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:29 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fd7604f7-eced-4558-a5af-a8dcca50a91a 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:29 devstack sudo[99232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fd7604f7-eced-4558-a5af-a8dcca50a91a 1073741824
Sep 16 08:46:29 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:29 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f66ab8ac-7162-4250-b428-17d60d5ea683" returned: 0 in 0.512s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f66ab8ac-7162-4250-b428-17d60d5ea683 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:29 devstack sudo[99239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f66ab8ac-7162-4250-b428-17d60d5ea683
Sep 16 08:46:29 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:29 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fd7604f7-eced-4558-a5af-a8dcca50a91a 1073741824" returned: 0 in 0.621s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:29 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Flow 'volume_create_manager' (5dfc7de6-c16e-46bf-9deb-bb9469113473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f93e4d-3546-4ea4-b3db-bda83b811e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fd7604f7-eced-4558-a5af-a8dcca50a91a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f66ab8ac-7162-4250-b428-17d60d5ea683" returned: 0 in 0.455s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:29 devstack sudo[99245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fd7604f7-eced-4558-a5af-a8dcca50a91a
Sep 16 08:46:29 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f93e4d-3546-4ea4-b3db-bda83b811e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f76860-469d-424d-a1ab-6de31c368456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f81de8376e54870977d93c2d871e439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:30Z,use_quota=True,user_id='66bb4f16db5640f797c02d8b1f7fb87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1c47d0-4563-40dc-88ca-57958fd7d771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1c47d0-4563-40dc-88ca-57958fd7d771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9002d836-2cbd-4894-bd82-4acf5a88fadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9002d836-2cbd-4894-bd82-4acf5a88fadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66f76860-469d-424d-a1ab-6de31c368456', 'volume_name': 'volume-66f76860-469d-424d-a1ab-6de31c368456', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823d39e7-dbd9-4fcc-8b1d-596da594e2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823d39e7-dbd9-4fcc-8b1d-596da594e2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa79cc83-fa45-49a8-bc07-a5613543276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:29 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Volume 66f76860-469d-424d-a1ab-6de31c368456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66f76860-469d-424d-a1ab-6de31c368456', 'volume_size': 1}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-quobyte-f66ab8ac-7162-4250-b428-17d60d5ea683" released by "delete_volume" :: held 1.100s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Created reservations ['a68a1e95-e7af-49a8-99f2-c928be72522a', '490be0b6-2b36-45c5-9682-cbb3e5e8a0cf', '727d8d24-93db-4db8-b8c4-753c70a0bf24', '4ddee040-1f63-41f9-9e68-a15b887cedb4'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:30 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:30 devstack sudo[99248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fd7604f7-eced-4558-a5af-a8dcca50a91a" returned: 0 in 0.293s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:30 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f76860-469d-424d-a1ab-6de31c368456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f81de8376e54870977d93c2d871e439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:30Z,use_quota=True,user_id='66bb4f16db5640f797c02d8b1f7fb87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Creating volume 66f76860-469d-424d-a1ab-6de31c368456 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:30 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-66f76860-469d-424d-a1ab-6de31c368456 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860cc0cc-592f-4fc7-8ed6-b26304e5efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd7604f7-eced-4558-a5af-a8dcca50a91a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:30 devstack sudo[99250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-66f76860-469d-424d-a1ab-6de31c368456 1073741824
Sep 16 08:46:30 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9477d819-b386-4486-87b8-7ad470c26512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:30 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Volume volume-fd7604f7-eced-4558-a5af-a8dcca50a91a (fd7604f7-eced-4558-a5af-a8dcca50a91a): created successfully
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9477d819-b386-4486-87b8-7ad470c26512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Flow 'volume_create_manager' (e636acd7-99e9-4178-90fe-797b893e0e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b57c6b87-1066-4eb5-bea9-e7abdf9390a8 tempest-VolumesListAdminTestJSON-389459537 None] Created volume successfully.
Sep 16 08:46:30 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.295s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Deleted volume successfully.
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1eed5c92-9451-4d08-be4f-e728694c501c tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-f66ab8ac-7162-4250-b428-17d60d5ea683-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:30 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-66f76860-469d-424d-a1ab-6de31c368456 1073741824" returned: 0 in 0.510s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-66f76860-469d-424d-a1ab-6de31c368456 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:30 devstack sudo[99257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-66f76860-469d-424d-a1ab-6de31c368456
Sep 16 08:46:30 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:30 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-66f76860-469d-424d-a1ab-6de31c368456" returned: 0 in 0.280s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa79cc83-fa45-49a8-bc07-a5613543276a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f76860-469d-424d-a1ab-6de31c368456', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cba3ae5-e4e5-4534-bfdf-e8f51514d1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "cinder-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:31 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Volume volume-66f76860-469d-424d-a1ab-6de31c368456 (66f76860-469d-424d-a1ab-6de31c368456): created successfully
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cba3ae5-e4e5-4534-bfdf-e8f51514d1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Flow 'volume_create_manager' (5dfc7de6-c16e-46bf-9deb-bb9469113473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:31 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2fccfe5f-81fe-4bee-a913-3e66e2fc9e0c tempest-CinderUnicodeTest-654974995 None] Created volume successfully.
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Acquiring lock "cinder-fd7604f7-eced-4558-a5af-a8dcca50a91a-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "cinder-quobyte-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Lock "cinder-fd7604f7-eced-4558-a5af-a8dcca50a91a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-quobyte-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb77ed38-0c94-4cc6-9926-e5045c0af8ac]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Acquiring lock "cinder-quobyte-fd7604f7-eced-4558-a5af-a8dcca50a91a" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Lock "cinder-quobyte-fd7604f7-eced-4558-a5af-a8dcca50a91a" acquired by "delete_volume" :: waited 0.036s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "cinder-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b201853-9de3-4b04-83ff-c9ae5dea4569]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fd7604f7-eced-4558-a5af-a8dcca50a91a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "cinder-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:31 devstack sudo[99260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b
Sep 16 08:46:31 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "cinder-quobyte-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "cinder-quobyte-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48d9e91-9a6f-4e78-bf9f-0ba6f842912e]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:31 devstack sudo[99262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fd7604f7-eced-4558-a5af-a8dcca50a91a
Sep 16 08:46:31 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:31 devstack sudo[99264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908
Sep 16 08:46:31 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:31 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b" returned: 0 in 0.474s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:31 devstack sudo[99272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b
Sep 16 08:46:31 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:31 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fd7604f7-eced-4558-a5af-a8dcca50a91a" returned: 0 in 0.504s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fd7604f7-eced-4558-a5af-a8dcca50a91a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:31 devstack sudo[99279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fd7604f7-eced-4558-a5af-a8dcca50a91a
Sep 16 08:46:31 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:31 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908" returned: 0 in 0.480s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:32 devstack sudo[99281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908
Sep 16 08:46:32 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:32 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b" returned: 0 in 0.412s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-quobyte-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b" released by "delete_volume" :: held 0.985s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Created reservations ['d524ddfb-2ee2-4c8f-8c31-06b5df548418', '6b5a5b13-0904-4617-8d84-6d9f9ec7cdac', '893bc975-bcab-4023-be31-bb31dec89bc8', 'b0e8f385-7706-4d4a-bcac-adbf0f842158'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:32 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908" returned: 0 in 0.400s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:32 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fd7604f7-eced-4558-a5af-a8dcca50a91a" returned: 0 in 0.518s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "cinder-quobyte-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908" released by "delete_volume" :: held 0.963s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Lock "cinder-quobyte-fd7604f7-eced-4558-a5af-a8dcca50a91a" released by "delete_volume" :: held 1.117s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:32 devstack sudo[99286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:32 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Created reservations ['dae61203-8b6f-45e1-8475-ce090db52fd3', 'f9604073-c6d9-4f28-96f8-c5de6989e9bd', 'ace05db4-1ec1-47cd-a33d-25507003d1fc', '85569e50-4a54-4446-bb85-e1ee369522bf'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Created reservations ['996215cd-a1db-4cd6-8a69-803b828a802a', '2cb8a103-22ef-4e45-addc-35929a778ae4', '6fc3bf47-feae-4777-b2e9-4ad12cc525df', 'acdfbcda-2cde-4bfc-8181-fd6f51af5782'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:32 devstack sudo[99288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:32 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:32 devstack sudo[99290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:32 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Flow 'volume_create_manager' (2ae44cbb-c1a2-413c-a426-75794790601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bd0328-65de-4ea8-a6e1-214409118917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:32 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bd0328-65de-4ea8-a6e1-214409118917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1447785921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8892d4-69d1-4a02-b4a3-e796f69cefbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539c81c386f14c97918edacda7ef1c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:33Z,use_quota=True,user_id='39b5fdff93384ae88def018a635e2f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34104fb-e38e-40c1-95bf-9fc3a448f0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34104fb-e38e-40c1-95bf-9fc3a448f0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8793ed75-7387-49a9-be4f-0b1fa81d1c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8793ed75-7387-49a9-be4f-0b1fa81d1c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc8892d4-69d1-4a02-b4a3-e796f69cefbc', 'volume_name': 'volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c61ac4f-ca59-468d-ab7c-30e0532ab882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c61ac4f-ca59-468d-ab7c-30e0532ab882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7be26f-4c85-4073-9e8a-226d0bca9b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:32 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Volume cc8892d4-69d1-4a02-b4a3-e796f69cefbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc', 'volume_size': 1}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1447785921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8892d4-69d1-4a02-b4a3-e796f69cefbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539c81c386f14c97918edacda7ef1c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:33Z,use_quota=True,user_id='39b5fdff93384ae88def018a635e2f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Creating volume cc8892d4-69d1-4a02-b4a3-e796f69cefbc {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:32 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.365s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:32 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Deleted volume successfully.
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:32 devstack sudo[99293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc 1073741824
Sep 16 08:46:32 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Flow 'volume_create_manager' (4f2d5040-2eba-4133-a2ce-655bb7b3a9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574d6ed3-c776-4c67-80ba-121b523d7cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574d6ed3-c776-4c67-80ba-121b523d7cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-358739371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447d538b-15e8-4569-8b8b-c63ec418daef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f81de8376e54870977d93c2d871e439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:33Z,use_quota=True,user_id='66bb4f16db5640f797c02d8b1f7fb87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630afd36-2899-4651-ade2-c963fa4f7a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630afd36-2899-4651-ade2-c963fa4f7a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831f2964-e7f5-4782-9a2b-f1ec2f72e3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831f2964-e7f5-4782-9a2b-f1ec2f72e3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '447d538b-15e8-4569-8b8b-c63ec418daef', 'volume_name': 'volume-447d538b-15e8-4569-8b8b-c63ec418daef', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:32 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4862260-ccc3-4935-9fae-e18b5a467556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4862260-ccc3-4935-9fae-e18b5a467556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66f629b-1073-483a-abde-6e0a1af28d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:32 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Volume 447d538b-15e8-4569-8b8b-c63ec418daef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-447d538b-15e8-4569-8b8b-c63ec418daef', 'volume_size': 1}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-57c46ea0-ca8a-46f2-924a-975f1742ed7e tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-db1f3cb3-4298-4976-9b36-7bc1ee2ade2b-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.337s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:32 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Deleted volume successfully.
Sep 16 08:46:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5a865220-ec60-4259-9486-44f22bd219c3 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "cinder-6b93cb4e-aabb-4e93-a5b4-1a818a3dd908-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:33 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.321s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:33 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Deleted volume successfully.
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fe0c87b5-98de-4e54-b2ad-1a58407a95f2 tempest-VolumesListAdminTestJSON-389459537 None] Lock "cinder-fd7604f7-eced-4558-a5af-a8dcca50a91a-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:33 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc 1073741824" returned: 0 in 0.477s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:33 devstack sudo[99301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc
Sep 16 08:46:33 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "cinder-1f7f1e7a-7670-4ade-9b6f-8994689f54dc-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-1f7f1e7a-7670-4ade-9b6f-8994689f54dc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "cinder-quobyte-1f7f1e7a-7670-4ade-9b6f-8994689f54dc" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-quobyte-1f7f1e7a-7670-4ade-9b6f-8994689f54dc" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2a1502-56eb-4b2d-9ded-d75165f314ea]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:33 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc" returned: 0 in 0.294s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-358739371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447d538b-15e8-4569-8b8b-c63ec418daef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f81de8376e54870977d93c2d871e439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:33Z,use_quota=True,user_id='66bb4f16db5640f797c02d8b1f7fb87c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Creating volume 447d538b-15e8-4569-8b8b-c63ec418daef {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:33 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:33 devstack sudo[99305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef 1073741824
Sep 16 08:46:33 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7be26f-4c85-4073-9e8a-226d0bca9b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02900c78-c0be-494e-9242-35f51f25489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "cinder-9aab825e-064c-4690-818e-80593c1fc7d0-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:33 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Volume volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc (cc8892d4-69d1-4a02-b4a3-e796f69cefbc): created successfully
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02900c78-c0be-494e-9242-35f51f25489b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Flow 'volume_create_manager' (2ae44cbb-c1a2-413c-a426-75794790601d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:33 devstack sudo[99304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc
Sep 16 08:46:33 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Lock "cinder-9aab825e-064c-4690-818e-80593c1fc7d0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:33 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f209a7eb-1c7e-40d0-819f-6aa00653fa25 tempest-VolumesTransfersV355Test-1300901761 None] Created volume successfully.
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "cinder-quobyte-9aab825e-064c-4690-818e-80593c1fc7d0" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Lock "cinder-quobyte-9aab825e-064c-4690-818e-80593c1fc7d0" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[824d2473-e330-459b-94c2-f7ded711b0dc]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9aab825e-064c-4690-818e-80593c1fc7d0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:34 devstack sudo[99308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9aab825e-064c-4690-818e-80593c1fc7d0
Sep 16 08:46:34 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:34 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc" returned: 0 in 0.415s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:34 devstack sudo[99316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc
Sep 16 08:46:34 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:34 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef 1073741824" returned: 0 in 0.519s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:34 devstack sudo[99319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef
Sep 16 08:46:34 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:34 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9aab825e-064c-4690-818e-80593c1fc7d0" returned: 0 in 0.447s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9aab825e-064c-4690-818e-80593c1fc7d0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:34 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1f7f1e7a-7670-4ade-9b6f-8994689f54dc" returned: 0 in 0.290s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:34 devstack sudo[99324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9aab825e-064c-4690-818e-80593c1fc7d0
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-quobyte-1f7f1e7a-7670-4ade-9b6f-8994689f54dc" released by "delete_volume" :: held 0.755s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:34 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Created reservations ['8b1d385e-2b58-466a-b512-fbbf53436ee5', '1811ed40-548c-4ddb-a0ea-0aa9554b159e', 'f7cedbef-595b-43be-b677-3701da25f842', '178b2fef-8903-443d-a204-d32bcb79c0d9'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:34 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:34 devstack sudo[99327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:34 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef" returned: 0 in 0.327s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66f629b-1073-483a-abde-6e0a1af28d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-447d538b-15e8-4569-8b8b-c63ec418daef', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e31023-9a06-4cc3-9514-dd85739b8599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:34 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Volume volume-447d538b-15e8-4569-8b8b-c63ec418daef (447d538b-15e8-4569-8b8b-c63ec418daef): created successfully
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e31023-9a06-4cc3-9514-dd85739b8599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Flow 'volume_create_manager' (4f2d5040-2eba-4133-a2ce-655bb7b3a9c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-be06a047-5618-43bf-8f4a-ad50a4f6ad24 tempest-CinderUnicodeTest-654974995 None] Created volume successfully.
Sep 16 08:46:34 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9aab825e-064c-4690-818e-80593c1fc7d0" returned: 0 in 0.352s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Lock "cinder-quobyte-9aab825e-064c-4690-818e-80593c1fc7d0" released by "delete_volume" :: held 0.850s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "cinder-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Created reservations ['0b10a7cc-9ea3-4154-b62f-473dce410319', 'aeab6465-258a-4837-8ac3-fcb113f8ba43', 'd8ff49f5-6667-4203-a41f-db59f254273e', '73c21054-a6e6-485c-8087-dbd3b32c2c44'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "cinder-quobyte-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.342s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:34 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Deleted volume successfully.
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-quobyte-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b" acquired by "delete_volume" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4b9259f6-8605-4e45-bd87-72095c211f50 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-1f7f1e7a-7670-4ade-9b6f-8994689f54dc-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2672b2d-44a0-4826-a4b8-57142c65fff2]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:35 devstack sudo[99332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:35 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:35 devstack sudo[99331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b
Sep 16 08:46:35 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] Creating offline snapshot 729ffccf-2205-476d-ac4c-d7e8f32e62e1 of volume 447d538b-15e8-4569-8b8b-c63ec418daef {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "cinder-f65148e9-9975-445f-8b91-eeade361a7a6-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[86faf417-a647-43b7-8bf4-414304e29690]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "cinder-f65148e9-9975-445f-8b91-eeade361a7a6-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:35 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.406s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:35 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Deleted volume successfully.
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-934177ae-9a6a-4ce5-84a4-2a26d121012a tempest-VolumesListAdminTestJSON-1673442756 None] Lock "cinder-9aab825e-064c-4690-818e-80593c1fc7d0-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "cinder-quobyte-f65148e9-9975-445f-8b91-eeade361a7a6" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "cinder-quobyte-f65148e9-9975-445f-8b91-eeade361a7a6" acquired by "delete_volume" :: waited 0.033s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:35 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b" returned: 0 in 0.599s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc85bb2-1864-4a16-bbf5-863a6ee38f1b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f65148e9-9975-445f-8b91-eeade361a7a6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:35 devstack sudo[99340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b
Sep 16 08:46:35 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:35 devstack sudo[99337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef
Sep 16 08:46:35 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:35 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5c7d8765-2fb8-4f9a-9dbf-3a9652e57a58 tempest-VolumesTransfersV355Test-822241679 None] Transfer volume completed successfully.
Sep 16 08:46:35 devstack sudo[99341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f65148e9-9975-445f-8b91-eeade361a7a6
Sep 16 08:46:35 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:35 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef" returned: 0 in 0.558s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:35 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b" returned: 0 in 0.373s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-quobyte-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b" released by "delete_volume" :: held 1.060s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:35 devstack sudo[99351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1 1G
Sep 16 08:46:35 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:35 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Created reservations ['953d2add-6252-4caf-87a9-3a302344e99c', 'b3676921-8f99-4918-b614-815d4d250c5d', '076b8a31-4589-404e-9815-cf9767710c6f', '58ab4f6d-3c28-4801-87fe-d5af4fd4622d'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:36 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f65148e9-9975-445f-8b91-eeade361a7a6" returned: 0 in 0.462s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f65148e9-9975-445f-8b91-eeade361a7a6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:36 devstack sudo[99354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f65148e9-9975-445f-8b91-eeade361a7a6
Sep 16 08:46:36 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:36 devstack sudo[99356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:36 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Acquiring lock "cinder-cc8892d4-69d1-4a02-b4a3-e796f69cefbc-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Lock "cinder-cc8892d4-69d1-4a02-b4a3-e796f69cefbc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Acquiring lock "cinder-quobyte-cc8892d4-69d1-4a02-b4a3-e796f69cefbc" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:36 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f65148e9-9975-445f-8b91-eeade361a7a6" returned: 0 in 0.365s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "cinder-quobyte-f65148e9-9975-445f-8b91-eeade361a7a6" released by "delete_volume" :: held 0.910s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Lock "cinder-quobyte-cc8892d4-69d1-4a02-b4a3-e796f69cefbc" acquired by "delete_volume" :: waited 0.086s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f127ddc-91e8-4efb-bb48-4f4f99961510]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:36 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.395s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:36 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:36 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Deleted volume successfully.
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1 1G" returned: 0 in 0.623s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-447d538b-15e8-4569-8b8b-c63ec418daef -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:36 devstack sudo[99365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-447d538b-15e8-4569-8b8b-c63ec418daef -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1
Sep 16 08:46:36 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Created reservations ['1ad94bbc-9c13-485d-ad94-9611c82d6184', 'a8efb9a6-246f-4439-95cd-3989647faeec', 'd85b154c-9c6f-45f9-98e3-b27fb119db53', '5dd3bcf6-9638-4bf4-8117-aba8648bbf8c'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f4748ed1-e2ad-4e85-8bf2-325b2f50f369 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-fcb51d4a-05e6-4ed7-a653-c2a8d20c772b-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:36 devstack sudo[99364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc
Sep 16 08:46:36 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:36 devstack sudo[99368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:36 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:36 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-447d538b-15e8-4569-8b8b-c63ec418daef -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1" returned: 0 in 0.317s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:36 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1 is being set with open permissions: ugo+rw
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:36 devstack sudo[99376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1
Sep 16 08:46:36 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:36 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc" returned: 0 in 0.419s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:36 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.268s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:36 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Deleted volume successfully.
Sep 16 08:46:36 devstack sudo[99380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc
Sep 16 08:46:36 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44c15041-02e7-492c-a631-acd23245a049 tempest-VolumesListAdminTestJSON-1673442756 None] Lock "cinder-f65148e9-9975-445f-8b91-eeade361a7a6-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "cinder-98edad98-7300-44cf-a7ca-5a7b954f98c7-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-98edad98-7300-44cf-a7ca-5a7b954f98c7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "cinder-quobyte-98edad98-7300-44cf-a7ca-5a7b954f98c7" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-quobyte-98edad98-7300-44cf-a7ca-5a7b954f98c7" acquired by "delete_volume" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:37 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1" returned: 0 in 0.315s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe49459-e37b-4a51-a5a7-968b8a1e68ee]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-98edad98-7300-44cf-a7ca-5a7b954f98c7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:37 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cc8892d4-69d1-4a02-b4a3-e796f69cefbc" returned: 0 in 0.291s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Lock "cinder-quobyte-cc8892d4-69d1-4a02-b4a3-e796f69cefbc" released by "delete_volume" :: held 0.786s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:37 devstack sudo[99385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.info
Sep 16 08:46:37 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Created reservations ['85291f7f-5b5a-46f3-bc8d-4ad42db4394d', '0c12defe-6244-4fc3-8bc5-3671d4257240', '3496352a-e762-4c9a-b5e3-ffe77af1ce05', '9854d99b-c0a2-4e93-9fa7-f2f32fbfd6b8'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:37 devstack sudo[99384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-98edad98-7300-44cf-a7ca-5a7b954f98c7
Sep 16 08:46:37 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:37 devstack sudo[99388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:37 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:37 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.info" returned: 0 in 0.322s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:37 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.info is being set with open permissions: ugo+rw
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:37 devstack sudo[99393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.info
Sep 16 08:46:37 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:37 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.302s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:37 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-98edad98-7300-44cf-a7ca-5a7b954f98c7" returned: 0 in 0.508s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-98edad98-7300-44cf-a7ca-5a7b954f98c7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Deleted volume successfully.
Sep 16 08:46:37 devstack sudo[99397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-98edad98-7300-44cf-a7ca-5a7b954f98c7
Sep 16 08:46:37 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f7f20b54-7f37-458f-9a54-a05ef830704b tempest-VolumesTransfersV355Test-1213702681 None] Lock "cinder-cc8892d4-69d1-4a02-b4a3-e796f69cefbc-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:37 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.info" returned: 0 in 0.368s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ca2d05df-e42c-4010-bd4d-7b252709191c tempest-CinderUnicodeTest-654974995 None] Create snapshot completed successfully
Sep 16 08:46:38 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-98edad98-7300-44cf-a7ca-5a7b954f98c7" returned: 0 in 0.370s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-quobyte-98edad98-7300-44cf-a7ca-5a7b954f98c7" released by "delete_volume" :: held 0.929s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Created reservations ['dd9f4366-53fc-487f-bb20-abdf8fd324da', '58bb6165-9f64-48fd-8f6c-aa1ab8f961d1', '88832958-a863-4ea6-a46e-6faa6318b1e4', '73e5a935-23a9-4cfd-abe6-f9ed82be366e'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Flow 'volume_create_manager' (645804f6-ae31-48ba-b01c-359cb44177f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70b254d-069e-439a-89fb-f5658bf9b7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "cinder-e5befed6-0a5a-4474-81ab-7a885d014c87-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:38 devstack sudo[99401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70b254d-069e-439a-89fb-f5658bf9b7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1624426048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de26b57e-a5da-4d30-b1ee-6ad55804431a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539c81c386f14c97918edacda7ef1c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:38Z,use_quota=True,user_id='39b5fdff93384ae88def018a635e2f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:38 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d4bdc3-bbde-4898-b506-a99cc4cdc0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d4bdc3-bbde-4898-b506-a99cc4cdc0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b305240d-12cc-4bc9-bb0e-7572391de57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b305240d-12cc-4bc9-bb0e-7572391de57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de26b57e-a5da-4d30-b1ee-6ad55804431a', 'volume_name': 'volume-de26b57e-a5da-4d30-b1ee-6ad55804431a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b5e389-d809-4150-9210-a072db409001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b5e389-d809-4150-9210-a072db409001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d158de2b-4be7-4694-9072-8ee3f7201d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:38 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Volume de26b57e-a5da-4d30-b1ee-6ad55804431a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de26b57e-a5da-4d30-b1ee-6ad55804431a', 'volume_size': 1}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1624426048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de26b57e-a5da-4d30-b1ee-6ad55804431a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539c81c386f14c97918edacda7ef1c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:38Z,use_quota=True,user_id='39b5fdff93384ae88def018a635e2f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Creating volume de26b57e-a5da-4d30-b1ee-6ad55804431a {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:38 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-de26b57e-a5da-4d30-b1ee-6ad55804431a 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-e5befed6-0a5a-4474-81ab-7a885d014c87-delete_volume" acquired by "delete_volume" :: waited 0.177s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:38 devstack sudo[99403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-de26b57e-a5da-4d30-b1ee-6ad55804431a 1073741824
Sep 16 08:46:38 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "cinder-quobyte-e5befed6-0a5a-4474-81ab-7a885d014c87" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-quobyte-e5befed6-0a5a-4474-81ab-7a885d014c87" acquired by "delete_volume" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec00985-819e-4fb0-b4ad-de34fac1e116]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e5befed6-0a5a-4474-81ab-7a885d014c87 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Acquiring lock "cinder-729ffccf-2205-476d-ac4c-d7e8f32e62e1-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:38 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-729ffccf-2205-476d-ac4c-d7e8f32e62e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Acquiring lock "cinder-quobyte-447d538b-15e8-4569-8b8b-c63ec418daef" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.362s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Deleted volume successfully.
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-quobyte-447d538b-15e8-4569-8b8b-c63ec418daef" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Acquiring lock "cinder-quobyte-729ffccf-2205-476d-ac4c-d7e8f32e62e1" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80f5be8d-01ef-479b-883e-e1f691986f22 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-98edad98-7300-44cf-a7ca-5a7b954f98c7-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-quobyte-729ffccf-2205-476d-ac4c-d7e8f32e62e1" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Deleting offline snapshot 729ffccf-2205-476d-ac4c-d7e8f32e62e1 of volume 447d538b-15e8-4569-8b8b-c63ec418daef {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] snapshot_file for this snap is: volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc51fc4-8a69-44a3-a7de-d1f69b978562]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:38 devstack sudo[99405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e5befed6-0a5a-4474-81ab-7a885d014c87
Sep 16 08:46:38 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:38 devstack sudo[99410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1
Sep 16 08:46:38 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:39 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-de26b57e-a5da-4d30-b1ee-6ad55804431a 1073741824" returned: 0 in 0.592s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-de26b57e-a5da-4d30-b1ee-6ad55804431a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:39 devstack sudo[99416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-de26b57e-a5da-4d30-b1ee-6ad55804431a
Sep 16 08:46:39 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:39 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e5befed6-0a5a-4474-81ab-7a885d014c87" returned: 0 in 0.581s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e5befed6-0a5a-4474-81ab-7a885d014c87 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:39 devstack sudo[99419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e5befed6-0a5a-4474-81ab-7a885d014c87
Sep 16 08:46:39 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:39 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1" returned: 0 in 0.538s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-447d538b-15e8-4569-8b8b-c63ec418daef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:46:39 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-de26b57e-a5da-4d30-b1ee-6ad55804431a" returned: 0 in 0.311s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d158de2b-4be7-4694-9072-8ee3f7201d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de26b57e-a5da-4d30-b1ee-6ad55804431a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d662a4c-0b8d-4fe6-b303-53e838f7f976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c378b7d0-a519-49c3-93d5-8c6c4ff4106c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:39 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Volume volume-de26b57e-a5da-4d30-b1ee-6ad55804431a (de26b57e-a5da-4d30-b1ee-6ad55804431a): created successfully
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d662a4c-0b8d-4fe6-b303-53e838f7f976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Flow 'volume_create_manager' (645804f6-ae31-48ba-b01c-359cb44177f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:39 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7e9b0187-09cd-4ed4-b250-08b2e3dbce2e tempest-VolumesTransfersV355Test-1300901761 None] Created volume successfully.
Sep 16 08:46:39 devstack sudo[99427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef
Sep 16 08:46:39 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:39 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e5befed6-0a5a-4474-81ab-7a885d014c87" returned: 0 in 0.416s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-quobyte-e5befed6-0a5a-4474-81ab-7a885d014c87" released by "delete_volume" :: held 1.072s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Created reservations ['031f6243-bc7c-4680-9a2f-886fb08dd525', '4a354359-4b52-454d-8131-add6eb2b9191', '6c9798e4-6e5a-42c6-a709-4a02888a5ebf', 'ec6546d2-c1a6-443d-90bc-5c37c777a08f'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:39 devstack sudo[99431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:39 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:39 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef" returned: 0 in 0.429s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:39 devstack sudo[99435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1
Sep 16 08:46:39 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:40 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.318s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:40 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Deleted volume successfully.
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7c0976e4-9114-4e57-8204-c0ee58247d97 tempest-CreateVolumesFromSourceVolumeTest-860361569 None] Lock "cinder-e5befed6-0a5a-4474-81ab-7a885d014c87-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:40 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1" returned: 0 in 0.435s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:40 devstack sudo[99441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1
Sep 16 08:46:40 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Acquiring lock "cinder-de26b57e-a5da-4d30-b1ee-6ad55804431a-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Lock "cinder-de26b57e-a5da-4d30-b1ee-6ad55804431a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:40 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef.729ffccf-2205-476d-ac4c-d7e8f32e62e1" returned: 0 in 0.358s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Acquiring lock "cinder-quobyte-de26b57e-a5da-4d30-b1ee-6ad55804431a" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Lock "cinder-quobyte-de26b57e-a5da-4d30-b1ee-6ad55804431a" acquired by "delete_volume" :: waited 0.049s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-quobyte-729ffccf-2205-476d-ac4c-d7e8f32e62e1" released by "_delete_snapshot" :: held 1.964s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-quobyte-447d538b-15e8-4569-8b8b-c63ec418daef" released by "delete_snapshot" :: held 2.012s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae264a5d-42f3-45a0-a896-7e161abff174]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-de26b57e-a5da-4d30-b1ee-6ad55804431a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Created reservations ['026b3f70-e1ca-49ce-bcb3-4c0cf54bcebf', 'e582f2f3-0145-4caf-b9d0-1f71623a758c', '18d53340-4866-4447-8d5b-806e45bf58c2', 'b6390968-f623-48e4-ab1b-8df62b1e3135'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:40 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Delete snapshot completed successfully.
Sep 16 08:46:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9c1c5845-b574-43f9-800a-ba4ff61f3a56 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-729ffccf-2205-476d-ac4c-d7e8f32e62e1-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:40 devstack sudo[99444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-de26b57e-a5da-4d30-b1ee-6ad55804431a
Sep 16 08:46:40 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:41 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-de26b57e-a5da-4d30-b1ee-6ad55804431a" returned: 0 in 0.479s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-de26b57e-a5da-4d30-b1ee-6ad55804431a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:41 devstack sudo[99449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-de26b57e-a5da-4d30-b1ee-6ad55804431a
Sep 16 08:46:41 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:41 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-de26b57e-a5da-4d30-b1ee-6ad55804431a" returned: 0 in 0.309s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Lock "cinder-quobyte-de26b57e-a5da-4d30-b1ee-6ad55804431a" released by "delete_volume" :: held 0.855s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Created reservations ['67ac26af-1b09-45f0-9e42-bf773f87909a', '0606b2d5-ca04-4ca4-b37f-45b1af02bfb9', '4eac855e-c75e-4652-98f3-db1e279f2c06', '6ff25380-f291-4d02-a1e9-e9d55d2d2bd9'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:41 devstack sudo[99453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:41 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Acquiring lock "cinder-447d538b-15e8-4569-8b8b-c63ec418daef-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-447d538b-15e8-4569-8b8b-c63ec418daef-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Acquiring lock "cinder-quobyte-447d538b-15e8-4569-8b8b-c63ec418daef" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:42 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.351s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:42 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:42 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Deleted volume successfully.
Sep 16 08:46:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-quobyte-447d538b-15e8-4569-8b8b-c63ec418daef" acquired by "delete_volume" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-731151b7-8fac-40bd-91b2-c1668fc05f29 tempest-VolumesTransfersV355Test-1213702681 None] Lock "cinder-de26b57e-a5da-4d30-b1ee-6ad55804431a-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:42 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46af111-49ab-46c6-aeb9-81f66b96b721]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:42 devstack sudo[99456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef
Sep 16 08:46:42 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:42 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef" returned: 0 in 0.429s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:42 devstack sudo[99461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef
Sep 16 08:46:42 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:42 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-447d538b-15e8-4569-8b8b-c63ec418daef" returned: 0 in 0.297s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-quobyte-447d538b-15e8-4569-8b8b-c63ec418daef" released by "delete_volume" :: held 0.863s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Created reservations ['f5e4cb79-ef54-4264-b14f-33593dcb554d', '0d56b72a-a604-419a-ae42-b654cdd5859a', '36ed36c4-d697-4ad7-a201-b361c17e1817', '07ab8fb7-b4f5-4ca3-b200-419f777dc5c1'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:43 devstack sudo[99498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:43 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Acquiring lock "cinder-66f76860-469d-424d-a1ab-6de31c368456-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-66f76860-469d-424d-a1ab-6de31c368456-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Acquiring lock "cinder-quobyte-66f76860-469d-424d-a1ab-6de31c368456" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-quobyte-66f76860-469d-424d-a1ab-6de31c368456" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fc5fd8-4343-4e67-9bc0-818d34f8fbc7]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-66f76860-469d-424d-a1ab-6de31c368456 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:43 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.342s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:43 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Deleted volume successfully.
Sep 16 08:46:43 devstack sudo[99500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-66f76860-469d-424d-a1ab-6de31c368456
Sep 16 08:46:43 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-980b4c20-a2f3-4d5f-b24e-30bf1c2105f2 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-447d538b-15e8-4569-8b8b-c63ec418daef-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:43 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-66f76860-469d-424d-a1ab-6de31c368456" returned: 0 in 0.476s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-66f76860-469d-424d-a1ab-6de31c368456 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:43 devstack sudo[99509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-66f76860-469d-424d-a1ab-6de31c368456
Sep 16 08:46:43 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:44 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-66f76860-469d-424d-a1ab-6de31c368456" returned: 0 in 0.283s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-quobyte-66f76860-469d-424d-a1ab-6de31c368456" released by "delete_volume" :: held 0.835s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:44 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Created reservations ['7971535a-4132-4f6b-9f4a-7a2e8bf15888', '834d22db-b38f-4cb7-83a5-d3d2535371f3', '8ef64023-8f71-44f3-b64f-e28e9c0c498e', '20e6326e-2770-455a-9236-882c7d16d309'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:44 devstack sudo[99512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:44 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:44 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.311s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:44 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:44 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Deleted volume successfully.
Sep 16 08:46:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bfec62e8-b4d8-462d-a653-4d763151a814 tempest-CinderUnicodeTest-654974995 None] Lock "cinder-66f76860-469d-424d-a1ab-6de31c368456-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Flow 'volume_create_manager' (8d02ae69-8c45-42fa-82cf-5c2850deb214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68f89ac-8830-4ba2-90fc-4c84cf4aef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68f89ac-8830-4ba2-90fc-4c84cf4aef49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2009872852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4091aefb-f8b5-4ebc-ab31-69def803913c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9618278b43ec429591df80723a8ea66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:47Z,use_quota=True,user_id='0239d09a8fa34419a17b7e3114b24518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e69de9-3c94-4c87-9a82-b235b2a70043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e69de9-3c94-4c87-9a82-b235b2a70043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d250c5-28e9-42f8-819b-23c44782dd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d250c5-28e9-42f8-819b-23c44782dd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4091aefb-f8b5-4ebc-ab31-69def803913c', 'volume_name': 'volume-4091aefb-f8b5-4ebc-ab31-69def803913c', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ab67aa-b890-4c19-89c8-3c303a900cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ab67aa-b890-4c19-89c8-3c303a900cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e153b771-3c3c-4e77-95c3-3603c628c841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:46 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Volume 4091aefb-f8b5-4ebc-ab31-69def803913c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4091aefb-f8b5-4ebc-ab31-69def803913c', 'volume_size': 1}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2009872852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4091aefb-f8b5-4ebc-ab31-69def803913c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9618278b43ec429591df80723a8ea66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:47Z,use_quota=True,user_id='0239d09a8fa34419a17b7e3114b24518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Creating volume 4091aefb-f8b5-4ebc-ab31-69def803913c {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:46 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4091aefb-f8b5-4ebc-ab31-69def803913c 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:46 devstack sudo[99515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4091aefb-f8b5-4ebc-ab31-69def803913c 1073741824
Sep 16 08:46:46 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:47 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4091aefb-f8b5-4ebc-ab31-69def803913c 1073741824" returned: 0 in 0.669s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4091aefb-f8b5-4ebc-ab31-69def803913c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:47 devstack sudo[99521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4091aefb-f8b5-4ebc-ab31-69def803913c
Sep 16 08:46:47 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:47 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4091aefb-f8b5-4ebc-ab31-69def803913c" returned: 0 in 0.315s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e153b771-3c3c-4e77-95c3-3603c628c841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4091aefb-f8b5-4ebc-ab31-69def803913c', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe121aa-f851-4d77-9214-e0772f4f2bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:47 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Volume volume-4091aefb-f8b5-4ebc-ab31-69def803913c (4091aefb-f8b5-4ebc-ab31-69def803913c): created successfully
Sep 16 08:46:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe121aa-f851-4d77-9214-e0772f4f2bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Flow 'volume_create_manager' (8d02ae69-8c45-42fa-82cf-5c2850deb214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:47 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-764f4103-3efd-49f7-a398-f15df32331a2 tempest-AbsoluteLimitsTests-1645440776 None] Created volume successfully.
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Acquiring lock "cinder-4091aefb-f8b5-4ebc-ab31-69def803913c-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Lock "cinder-4091aefb-f8b5-4ebc-ab31-69def803913c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Acquiring lock "cinder-quobyte-4091aefb-f8b5-4ebc-ab31-69def803913c" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Lock "cinder-quobyte-4091aefb-f8b5-4ebc-ab31-69def803913c" acquired by "delete_volume" :: waited 0.034s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Flow 'volume_create_manager' (41103233-d4b8-4932-a416-28d228b115b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9b65d8-07a4-4858-aa24-d68ddb3b8e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e855d504-14b9-4ab6-9256-c1d43636d98a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4091aefb-f8b5-4ebc-ab31-69def803913c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9b65d8-07a4-4858-aa24-d68ddb3b8e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f3eacc-8b04-4e73-8258-4ecb4898c299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7a089a6e0744eebe15bbb53897f520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:49Z,use_quota=True,user_id='5edcf0080cca4387a7638b2be7cce05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c857050-ff48-4f77-bdb8-4cac13dc3f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c857050-ff48-4f77-bdb8-4cac13dc3f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873a7fac-bf60-4ff5-af7b-e8efee310a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:49 devstack cinder-volume[86261]: DEBUG cinder.image.glance [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Creating Keystone auth plugin from conf {{(pid=86261) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 08:46:49 devstack sudo[99526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4091aefb-f8b5-4ebc-ab31-69def803913c
Sep 16 08:46:49 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:50 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4091aefb-f8b5-4ebc-ab31-69def803913c" returned: 0 in 0.437s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4091aefb-f8b5-4ebc-ab31-69def803913c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:50 devstack sudo[99532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4091aefb-f8b5-4ebc-ab31-69def803913c
Sep 16 08:46:50 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873a7fac-bf60-4ff5-af7b-e8efee310a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3f3eacc-8b04-4e73-8258-4ecb4898c299', 'volume_name': 'volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299', 'volume_size': 1, 'image_id': '86028854-c994-4c7a-9e65-17c128459ac3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86028854-c994-4c7a-9e65-17c128459ac3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '572ba928df6b9b4f12a66697b8ecb3eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a7a089a6e0744eebe15bbb53897f520', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '462b4395e2de5aec6780c36e941d898b6c284ab4b20b1ae85b16313e78cd8ca87a43f99e6f3bdf10d4c7dc2a7966a47c04a8cb4f9a22895d18cef8aca405f887', 'id': '86028854-c994-4c7a-9e65-17c128459ac3', 'created_at': datetime.datetime(2026, 9, 16, 6, 46, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 46, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86028854-c994-4c7a-9e65-17c128459ac3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef36aff0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2876babd-b691-438f-9cab-f15fea27222e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2876babd-b691-438f-9cab-f15fea27222e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7245c1-4446-41db-9f43-ca747eb34acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:50 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Volume b3f3eacc-8b04-4e73-8258-4ecb4898c299: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299', 'volume_size': 1, 'image_id': '86028854-c994-4c7a-9e65-17c128459ac3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86028854-c994-4c7a-9e65-17c128459ac3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '572ba928df6b9b4f12a66697b8ecb3eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a7a089a6e0744eebe15bbb53897f520', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '462b4395e2de5aec6780c36e941d898b6c284ab4b20b1ae85b16313e78cd8ca87a43f99e6f3bdf10d4c7dc2a7966a47c04a8cb4f9a22895d18cef8aca405f887', 'id': '86028854-c994-4c7a-9e65-17c128459ac3', 'created_at': datetime.datetime(2026, 9, 16, 6, 46, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 46, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86028854-c994-4c7a-9e65-17c128459ac3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef36aff0>}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Trying to clone b3f3eacc-8b04-4e73-8258-4ecb4898c299 from image 86028854-c994-4c7a-9e65-17c128459ac3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/86028854-c994-4c7a-9e65-17c128459ac3', 'metadata': {}}]). {{(pid=86261) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 08:46:50 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2af8c2-8e9e-48f8-aa99-389012f4f659]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:50 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4091aefb-f8b5-4ebc-ab31-69def803913c" returned: 0 in 0.401s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Lock "cinder-quobyte-4091aefb-f8b5-4ebc-ab31-69def803913c" released by "delete_volume" :: held 0.934s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:50 devstack sudo[99535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD
Sep 16 08:46:50 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Created reservations ['bee37d2f-f912-4ae2-a169-8dfdda9ca426', '0eda13d0-e0ab-4beb-a564-32a59dfebd38', '2ffa03e7-f347-48aa-bb0f-2ab8fde2f932', '106f8210-8da2-4036-ac38-8074d77ca2bd'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:50 devstack sudo[99537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:50 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:50 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD" returned: 0 in 0.481s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:50 devstack sudo[99541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD
Sep 16 08:46:50 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:50 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.357s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:51 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:51 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Deleted volume successfully.
Sep 16 08:46:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eec1498e-5000-4ed5-bcf3-a284b040d3fc tempest-AbsoluteLimitsTests-1645440776 None] Lock "cinder-4091aefb-f8b5-4ebc-ab31-69def803913c-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:51 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD" returned: 1 in 0.440s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:46:51 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Temporary image 86028854-c994-4c7a-9e65-17c128459ac3 is fetched for user 5edcf0080cca4387a7638b2be7cce05a. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 08:46:51 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9802e3b-b64b-4ff6-b2f4-35b60e3e2612]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:51 devstack sudo[99548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD
Sep 16 08:46:51 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:51 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:51 devstack sudo[99552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD
Sep 16 08:46:51 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:52 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD" returned: 1 in 0.376s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f3eacc-8b04-4e73-8258-4ecb4898c299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7a089a6e0744eebe15bbb53897f520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:49Z,use_quota=True,user_id='5edcf0080cca4387a7638b2be7cce05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Creating volume b3f3eacc-8b04-4e73-8258-4ecb4898c299 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:52 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:52 devstack sudo[99557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299 1073741824
Sep 16 08:46:52 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:52 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299 1073741824" returned: 0 in 0.635s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:52 devstack sudo[99563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299
Sep 16 08:46:52 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Flow 'volume_create_manager' (8f833994-2526-4e15-9d51-a2486466b87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8833b9f9-cdf1-46f3-9aa8-556035dc9756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8833b9f9-cdf1-46f3-9aa8-556035dc9756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-615801107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3dad34-71e6-4f87-b2d9-58f0fe7c0894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05660819f40449bc9727c21a89c88b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:53Z,use_quota=True,user_id='ba2a228e91d249deac9e072b35a083d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692bc67a-e75d-40ce-b9b2-8d44fb6a930f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692bc67a-e75d-40ce-b9b2-8d44fb6a930f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7fcf70-383c-446f-afb1-1da8f6b94b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7fcf70-383c-446f-afb1-1da8f6b94b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb3dad34-71e6-4f87-b2d9-58f0fe7c0894', 'volume_name': 'volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d64738-9e3b-4a8c-b3b5-e198f53c70f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d64738-9e3b-4a8c-b3b5-e198f53c70f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e41e7a-35a4-42f4-b91b-d416e0ea25fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:53 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Volume cb3dad34-71e6-4f87-b2d9-58f0fe7c0894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894', 'volume_size': 1}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:53 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299" returned: 0 in 0.345s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.074s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-615801107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3dad34-71e6-4f87-b2d9-58f0fe7c0894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05660819f40449bc9727c21a89c88b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:53Z,use_quota=True,user_id='ba2a228e91d249deac9e072b35a083d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Creating volume cb3dad34-71e6-4f87-b2d9-58f0fe7c0894 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:53 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:53 devstack sudo[99566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894 1073741824
Sep 16 08:46:53 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Attempting download of 86028854-c994-4c7a-9e65-17c128459ac3 ((None, [{'url': 'file:///opt/stack/data/glance/images/86028854-c994-4c7a-9e65-17c128459ac3', 'metadata': {}}])) to volume b3f3eacc-8b04-4e73-8258-4ecb4898c299. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d510b74f-a0a3-4f5e-97b4-b95937a09601]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86028854-c994-4c7a-9e65-17c128459ac3_n5t6kmn1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:53 devstack sudo[99568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86028854-c994-4c7a-9e65-17c128459ac3_n5t6kmn1
Sep 16 08:46:53 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:53 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86028854-c994-4c7a-9e65-17c128459ac3_n5t6kmn1" returned: 0 in 0.409s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86028854-c994-4c7a-9e65-17c128459ac3_n5t6kmn1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:53 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894 1073741824" returned: 0 in 0.616s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:53 devstack sudo[99577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894
Sep 16 08:46:53 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:53 devstack sudo[99576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86028854-c994-4c7a-9e65-17c128459ac3_n5t6kmn1
Sep 16 08:46:53 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:54 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894" returned: 0 in 0.346s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:54 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e41e7a-35a4-42f4-b91b-d416e0ea25fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28d1794-02a0-4a55-86a4-135dda629bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86028854-c994-4c7a-9e65-17c128459ac3_n5t6kmn1" returned: 1 in 0.501s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86028854-c994-4c7a-9e65-17c128459ac3_n5t6kmn1' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7b0baa-0b2c-419d-8e97-f817018190bc]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:54 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Volume volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894 (cb3dad34-71e6-4f87-b2d9-58f0fe7c0894): created successfully
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28d1794-02a0-4a55-86a4-135dda629bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Flow 'volume_create_manager' (8f833994-2526-4e15-9d51-a2486466b87a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:54 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-aef1e994-3290-4203-bfeb-34075915ceac tempest-VolumesTransfersV357Test-1645348263 None] Created volume successfully.
Sep 16 08:46:54 devstack sudo[99589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD
Sep 16 08:46:54 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:54 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:54 devstack sudo[99593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD
Sep 16 08:46:54 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:54 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD" returned: 1 in 0.362s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] 86028854-c994-4c7a-9e65-17c128459ac3 was raw, converting to qcow2 {{(pid=86261) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 08:46:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:54 devstack sudo[99598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299
Sep 16 08:46:54 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:55 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299" returned: 0 in 0.596s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:55 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86028854-c994-4c7a-9e65-17c128459ac3_d2k18020devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:46:55 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 08:46:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:55 devstack sudo[99603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299 1G
Sep 16 08:46:55 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:55 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299 1G" returned: 0 in 0.360s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:55 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Downloaded image 86028854-c994-4c7a-9e65-17c128459ac3 ((None, [{'url': 'file:///opt/stack/data/glance/images/86028854-c994-4c7a-9e65-17c128459ac3', 'metadata': {}}])) to volume b3f3eacc-8b04-4e73-8258-4ecb4898c299 successfully. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 08:46:55 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Temporary image 86028854-c994-4c7a-9e65-17c128459ac3 for user 5edcf0080cca4387a7638b2be7cce05a is deleted. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 08:46:55 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Marking volume b3f3eacc-8b04-4e73-8258-4ecb4898c299 as bootable. {{(pid=86261) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 08:46:55 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Copying metadata from image 86028854-c994-4c7a-9e65-17c128459ac3 to b3f3eacc-8b04-4e73-8258-4ecb4898c299. {{(pid=86261) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 08:46:55 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Creating volume glance metadata for volume b3f3eacc-8b04-4e73-8258-4ecb4898c299 backed by image 86028854-c994-4c7a-9e65-17c128459ac3 with: {'image_id': '86028854-c994-4c7a-9e65-17c128459ac3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '572ba928df6b9b4f12a66697b8ecb3eb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86261) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 08:46:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7245c1-4446-41db-9f43-ca747eb34acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299', 'volume_size': 1, 'image_id': '86028854-c994-4c7a-9e65-17c128459ac3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86028854-c994-4c7a-9e65-17c128459ac3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '572ba928df6b9b4f12a66697b8ecb3eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a7a089a6e0744eebe15bbb53897f520', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '462b4395e2de5aec6780c36e941d898b6c284ab4b20b1ae85b16313e78cd8ca87a43f99e6f3bdf10d4c7dc2a7966a47c04a8cb4f9a22895d18cef8aca405f887', 'id': '86028854-c994-4c7a-9e65-17c128459ac3', 'created_at': datetime.datetime(2026, 9, 16, 6, 46, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 46, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86028854-c994-4c7a-9e65-17c128459ac3/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef36aff0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec5c85e-c664-4170-941e-6e295b66df99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:56 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Volume volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299 (b3f3eacc-8b04-4e73-8258-4ecb4898c299): created successfully
Sep 16 08:46:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec5c85e-c664-4170-941e-6e295b66df99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Flow 'volume_create_manager' (41103233-d4b8-4932-a416-28d228b115b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:56 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-86145210-6835-4645-af85-dbbea91f364e tempest-VolumeImageDependencyTests-582567415 None] Created volume successfully.
Sep 16 08:46:56 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-be0e11cd-d661-49ca-8974-62d63ce39077 tempest-VolumesTransfersV357Test-1163775421 None] Transfer volume completed successfully.
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Acquiring lock "cinder-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Lock "cinder-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Acquiring lock "cinder-b3f3eacc-8b04-4e73-8258-4ecb4898c299-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Acquiring lock "cinder-quobyte-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Lock "cinder-b3f3eacc-8b04-4e73-8258-4ecb4898c299-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Lock "cinder-quobyte-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894" acquired by "delete_volume" :: waited 0.053s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Acquiring lock "cinder-quobyte-b3f3eacc-8b04-4e73-8258-4ecb4898c299" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0184ca-c4eb-4561-805a-5aad51b0e408]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Lock "cinder-quobyte-b3f3eacc-8b04-4e73-8258-4ecb4898c299" acquired by "delete_volume" :: waited 0.048s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0085a6-4746-49f9-9485-47bac8c40201]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:57 devstack sudo[99608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894
Sep 16 08:46:57 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:57 devstack sudo[99609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299
Sep 16 08:46:57 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:57 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894" returned: 0 in 0.461s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:57 devstack sudo[99618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894
Sep 16 08:46:57 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:57 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299" returned: 0 in 0.459s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:57 devstack sudo[99621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299
Sep 16 08:46:57 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:57 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894" returned: 0 in 0.314s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Lock "cinder-quobyte-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894" released by "delete_volume" :: held 0.841s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:58 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b3f3eacc-8b04-4e73-8258-4ecb4898c299" returned: 0 in 0.296s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Lock "cinder-quobyte-b3f3eacc-8b04-4e73-8258-4ecb4898c299" released by "delete_volume" :: held 0.820s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Created reservations ['890c0c07-738b-47a5-bcd5-97c867e09ee2', '83d2e256-e120-4dc2-8b59-ccca88bd7048', '4cad7a6d-df5f-4add-8bbb-c2106ad4e46d', 'b2a57840-92eb-412a-9abc-3f66d1b56803'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Created reservations ['0b91dcf3-b301-4fae-8a48-2b3af3e8f22b', '29aefadd-eb0c-4c27-8ff7-58a10ae819e6', '0e312bb2-7912-4e90-9728-acae7851811e', '5eb7cf9c-e970-4269-a4e0-56d6f05d3ccd'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:46:58 devstack sudo[99625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:58 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:58 devstack sudo[99627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:46:58 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Flow 'volume_create_manager' (18112c22-165f-49f1-88b0-a6b11b45df71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326fee81-2e19-457b-b344-1c9de7b7cad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326fee81-2e19-457b-b344-1c9de7b7cad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1938114444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965b9dbd-1a6c-4679-916c-626afbb36a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdcb289ec33499492dfac2886da3947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:58Z,use_quota=True,user_id='0af5ab3942584f58ae1a8d512f1a4dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f08449-c1eb-42fa-a0f8-01f7acd9f505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f08449-c1eb-42fa-a0f8-01f7acd9f505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce840fc5-1eb6-41e0-b950-f7fef984b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce840fc5-1eb6-41e0-b950-f7fef984b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '965b9dbd-1a6c-4679-916c-626afbb36a43', 'volume_name': 'volume-965b9dbd-1a6c-4679-916c-626afbb36a43', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0844a6-ee03-4970-abb2-d226212c28f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0844a6-ee03-4970-abb2-d226212c28f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1b5f8d-386c-4265-82e6-6e8d4f9432d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:58 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Volume 965b9dbd-1a6c-4679-916c-626afbb36a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-965b9dbd-1a6c-4679-916c-626afbb36a43', 'volume_size': 1}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1938114444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965b9dbd-1a6c-4679-916c-626afbb36a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdcb289ec33499492dfac2886da3947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:58Z,use_quota=True,user_id='0af5ab3942584f58ae1a8d512f1a4dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Creating volume 965b9dbd-1a6c-4679-916c-626afbb36a43 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:58 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:58 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.465s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:58 devstack sudo[99630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43 1073741824
Sep 16 08:46:58 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:58 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Deleted volume successfully.
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-892e0978-032c-4ae6-a693-89ce832ebccd tempest-VolumesTransfersV357Test-1341457790 None] Lock "cinder-cb3dad34-71e6-4f87-b2d9-58f0fe7c0894-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:58 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.398s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:46:58 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Deleted volume successfully.
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e743ec3f-6d32-4c96-883d-a5dbd38eafa1 tempest-VolumeImageDependencyTests-582567415 None] Lock "cinder-b3f3eacc-8b04-4e73-8258-4ecb4898c299-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:46:58 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Flow 'volume_create_manager' (ce83cd71-b469-420b-bcac-f4363a870f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca3a1cd-0de6-4a45-9e8e-ae614b4e9cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca3a1cd-0de6-4a45-9e8e-ae614b4e9cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1544991047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fc1e9e-a041-4e6e-9f06-2d05c7856e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05660819f40449bc9727c21a89c88b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:59Z,use_quota=True,user_id='ba2a228e91d249deac9e072b35a083d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a63f799-4a9f-4fc7-9230-af5de91e22f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a63f799-4a9f-4fc7-9230-af5de91e22f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06fa6fc-54ba-4b1f-adcc-8c38fd3bd8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06fa6fc-54ba-4b1f-adcc-8c38fd3bd8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0fc1e9e-a041-4e6e-9f06-2d05c7856e86', 'volume_name': 'volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c4e046-2d5b-4ada-b6d3-8a2da8eac89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c4e046-2d5b-4ada-b6d3-8a2da8eac89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80360ced-173d-40ca-8889-8daa67ba12ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:59 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Volume a0fc1e9e-a041-4e6e-9f06-2d05c7856e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86', 'volume_size': 1}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:59 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43 1073741824" returned: 0 in 0.561s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:59 devstack sudo[99637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43
Sep 16 08:46:59 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:59 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43" returned: 0 in 0.323s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1544991047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fc1e9e-a041-4e6e-9f06-2d05c7856e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05660819f40449bc9727c21a89c88b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:46:59Z,use_quota=True,user_id='ba2a228e91d249deac9e072b35a083d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Creating volume a0fc1e9e-a041-4e6e-9f06-2d05c7856e86 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:46:59 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1b5f8d-386c-4265-82e6-6e8d4f9432d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-965b9dbd-1a6c-4679-916c-626afbb36a43', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:59 devstack sudo[99640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86 1073741824
Sep 16 08:46:59 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (625dcf79-cf30-4317-bd82-600198a51c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:46:59 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Volume volume-965b9dbd-1a6c-4679-916c-626afbb36a43 (965b9dbd-1a6c-4679-916c-626afbb36a43): created successfully
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (625dcf79-cf30-4317-bd82-600198a51c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:46:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Flow 'volume_create_manager' (18112c22-165f-49f1-88b0-a6b11b45df71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:46:59 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8ed80c44-754d-4091-bf46-fecac4bc9dfe tempest-VolumesDeleteCascade-87239403 None] Created volume successfully.
Sep 16 08:47:00 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86 1073741824" returned: 0 in 0.558s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:00 devstack sudo[99646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86
Sep 16 08:47:00 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:00 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86" returned: 0 in 0.283s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80360ced-173d-40ca-8889-8daa67ba12ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b0498f-a3f2-485a-bf38-41f10774e539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:00 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Volume volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86 (a0fc1e9e-a041-4e6e-9f06-2d05c7856e86): created successfully
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b0498f-a3f2-485a-bf38-41f10774e539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Flow 'volume_create_manager' (ce83cd71-b469-420b-bcac-f4363a870f58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:00 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bf9fc4bd-e30a-40a1-963a-d4a780f84a20 tempest-VolumesTransfersV357Test-1645348263 None] Created volume successfully.
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] Creating offline snapshot 46438b66-4d12-4982-bb02-a5dd8497c7cf of volume 965b9dbd-1a6c-4679-916c-626afbb36a43 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9192b4-cb8d-42bc-a7d4-c04e22dd62fc]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:01 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43
Sep 16 08:47:01 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:01 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43" returned: 0 in 0.542s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Acquiring lock "cinder-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:01 devstack sudo[99656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf 1G
Sep 16 08:47:01 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Lock "cinder-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Acquiring lock "cinder-quobyte-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Lock "cinder-quobyte-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:01 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e24f6ed-952d-42b1-9ca8-197b1d950899]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:01 devstack sudo[99658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86
Sep 16 08:47:01 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:02 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf 1G" returned: 0 in 0.627s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965b9dbd-1a6c-4679-916c-626afbb36a43 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:02 devstack sudo[99665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965b9dbd-1a6c-4679-916c-626afbb36a43 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf
Sep 16 08:47:02 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:02 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86" returned: 0 in 0.516s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:02 devstack sudo[99669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86
Sep 16 08:47:02 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:02 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965b9dbd-1a6c-4679-916c-626afbb36a43 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf" returned: 0 in 0.361s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:02 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf is being set with open permissions: ugo+rw
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:02 devstack sudo[99675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf
Sep 16 08:47:02 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:02 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86" returned: 0 in 0.364s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Lock "cinder-quobyte-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86" released by "delete_volume" :: held 0.971s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Created reservations ['7a56c3c7-7a83-4855-8d60-ac9a4c0bd0e4', '3ef1d6fc-5a39-4a7d-a53e-bfdb81a7f804', '415a5ce6-a242-434e-9de4-6b862866eab4', '4a283e6a-f7af-4704-a406-2d34ff9f4792'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:02 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf" returned: 0 in 0.350s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:02 devstack sudo[99678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:02 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:02 devstack sudo[99680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.info
Sep 16 08:47:02 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:03 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.340s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:03 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Deleted volume successfully.
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1fd91d6-1adf-47bb-9d13-45d4ffe4b597 tempest-VolumesTransfersV357Test-1341457790 None] Lock "cinder-a0fc1e9e-a041-4e6e-9f06-2d05c7856e86-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:03 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.info" returned: 0 in 0.334s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:03 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.info is being set with open permissions: ugo+rw
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:03 devstack sudo[99684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.info
Sep 16 08:47:03 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Flow 'volume_create_manager' (78664f1a-0750-4dda-9b91-2c6500fe959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b696291-27d8-497d-b99f-451f294f4b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b696291-27d8-497d-b99f-451f294f4b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-246548356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e22f77-7376-4bcd-b4f3-f3dea06c41b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfbdb3dc2b24b298c529f895a8617ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:03Z,use_quota=True,user_id='4899094f4ca549089b9b4a9d1af09920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d1746f-00c2-48ee-994c-90f96960abb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d1746f-00c2-48ee-994c-90f96960abb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e5ae07-ef48-42c8-82af-666900b16915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e5ae07-ef48-42c8-82af-666900b16915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e22f77-7376-4bcd-b4f3-f3dea06c41b8', 'volume_name': 'volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb4e3ab-cb3b-4bdd-b609-7f094b04ce32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb4e3ab-cb3b-4bdd-b609-7f094b04ce32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08e787e-5e80-4097-8d29-4f7ba181c181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:03 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Volume b4e22f77-7376-4bcd-b4f3-f3dea06c41b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8', 'volume_size': 1}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:03 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.info" returned: 0 in 0.269s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.141s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-246548356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e22f77-7376-4bcd-b4f3-f3dea06c41b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfbdb3dc2b24b298c529f895a8617ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:03Z,use_quota=True,user_id='4899094f4ca549089b9b4a9d1af09920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Creating volume b4e22f77-7376-4bcd-b4f3-f3dea06c41b8 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:47:03 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:47:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:03 devstack sudo[99687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8 1073741824
Sep 16 08:47:03 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:03 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7f237941-774e-4b3a-aaef-8042f99adc85 tempest-VolumesDeleteCascade-87239403 None] Create snapshot completed successfully
Sep 16 08:47:04 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8 1073741824" returned: 0 in 0.592s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:04 devstack sudo[99694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8
Sep 16 08:47:04 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Flow 'volume_create_manager' (081396ec-b92c-4ace-af36-4c7b5b2fd8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d691a20-7210-4060-a5c7-c357f38a11e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d691a20-7210-4060-a5c7-c357f38a11e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1161718847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c056219e-7557-4ff1-8d6d-23b3cea9cae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0c8cd7279f47ccaa1ec8a3983cf9c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:04Z,use_quota=True,user_id='3ad4752f105548abac56125df34f61d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d02cd61f-73b6-443b-9aac-a9dd6dd6f096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d02cd61f-73b6-443b-9aac-a9dd6dd6f096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323be642-a47c-45c2-8f77-2f77acd838e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323be642-a47c-45c2-8f77-2f77acd838e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c056219e-7557-4ff1-8d6d-23b3cea9cae7', 'volume_name': 'volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:04 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c309e3e-9447-4763-9785-01a5c0bbaf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c309e3e-9447-4763-9785-01a5c0bbaf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e780489d-6987-433d-9f90-74c15f716103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:04 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Volume c056219e-7557-4ff1-8d6d-23b3cea9cae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7', 'volume_size': 1}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8" returned: 0 in 0.384s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1161718847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c056219e-7557-4ff1-8d6d-23b3cea9cae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0c8cd7279f47ccaa1ec8a3983cf9c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:04Z,use_quota=True,user_id='3ad4752f105548abac56125df34f61d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Creating volume c056219e-7557-4ff1-8d6d-23b3cea9cae7 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:47:04 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:04 devstack sudo[99697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7 1073741824
Sep 16 08:47:04 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08e787e-5e80-4097-8d29-4f7ba181c181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17736f3a-9696-47b3-a5ca-23aa9c497a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:04 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Volume volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8 (b4e22f77-7376-4bcd-b4f3-f3dea06c41b8): created successfully
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17736f3a-9696-47b3-a5ca-23aa9c497a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Flow 'volume_create_manager' (78664f1a-0750-4dda-9b91-2c6500fe959b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:04 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e66689ad-45dc-4593-9dbd-ec8a7db94d3a tempest-ProjectReaderTests-167686358 None] Created volume successfully.
Sep 16 08:47:04 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7 1073741824" returned: 0 in 0.453s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:05 devstack sudo[99703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7
Sep 16 08:47:05 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:05 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7" returned: 0 in 0.261s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.730s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e780489d-6987-433d-9f90-74c15f716103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17f63ca-5fb6-4b82-87d6-d63978f2aa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] Creating offline snapshot ad6f96dd-618c-41a7-b522-c80f3c225409 of volume 965b9dbd-1a6c-4679-916c-626afbb36a43 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:47:05 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Volume volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7 (c056219e-7557-4ff1-8d6d-23b3cea9cae7): created successfully
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17f63ca-5fb6-4b82-87d6-d63978f2aa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Flow 'volume_create_manager' (081396ec-b92c-4ace-af36-4c7b5b2fd8de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b90e0b0-d7a0-485e-b209-2d3b21c62f65]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:05 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9c80f585-3e9f-4716-a70c-61d2a209d035 tempest-ProjectReaderTests-509758448 None] Created volume successfully.
Sep 16 08:47:05 devstack sudo[99706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf
Sep 16 08:47:05 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Acquiring lock "cinder-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Lock "cinder-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Acquiring lock "cinder-quobyte-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Lock "cinder-quobyte-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[41510082-4ac0-45f4-9f7d-0bf17faffc48]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:05 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf" returned: 0 in 0.451s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-965b9dbd-1a6c-4679-916c-626afbb36a43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:47:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:05 devstack sudo[99708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8
Sep 16 08:47:05 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:05 devstack sudo[99712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 1G
Sep 16 08:47:05 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:06 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8" returned: 0 in 0.433s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:06 devstack sudo[99721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8
Sep 16 08:47:06 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:06 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 1G" returned: 0 in 0.574s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:06 devstack sudo[99723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409
Sep 16 08:47:06 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:06 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Acquiring lock "cinder-c056219e-7557-4ff1-8d6d-23b3cea9cae7-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8" returned: 0 in 0.339s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Lock "cinder-c056219e-7557-4ff1-8d6d-23b3cea9cae7-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Lock "cinder-quobyte-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8" released by "delete_volume" :: held 0.864s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Acquiring lock "cinder-quobyte-c056219e-7557-4ff1-8d6d-23b3cea9cae7" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Lock "cinder-quobyte-c056219e-7557-4ff1-8d6d-23b3cea9cae7" acquired by "delete_volume" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Created reservations ['5497edbc-1a19-4409-bb3d-53ec9afbea03', '1103d091-c0b8-4ee0-8644-5acfa33f7342', 'a70d72d2-8bad-443f-8f51-59be90267c74', '08d4d033-20c1-4c7e-8c6c-7bfbd439074b'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41d9dea-bb98-4960-92e8-fea05cd5eedc]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:06 devstack sudo[99730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:06 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:06 devstack sudo[99727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7
Sep 16 08:47:06 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:06 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409" returned: 0 in 0.430s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:06 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 is being set with open permissions: ugo+rw
Sep 16 08:47:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:06 devstack sudo[99733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409
Sep 16 08:47:06 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:07 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409" returned: 0 in 0.308s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:07 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.393s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:07 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:07 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Deleted volume successfully.
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7" returned: 0 in 0.575s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:07 devstack sudo[99740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7
Sep 16 08:47:07 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:07 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b8523082-6ad3-4e2a-b828-a37dba444073 tempest-VolumesDeleteCascade-87239403 None] Create snapshot completed successfully
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2fa058e8-99d0-479f-9351-519728b89596 tempest-ProjectReaderTests-167686358 None] Lock "cinder-b4e22f77-7376-4bcd-b4f3-f3dea06c41b8-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Flow 'volume_create_manager' (df2f5898-31ab-40c7-8a87-d7c0e9b915ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f9678ce-0b85-4aec-a754-57a2f4b83aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-965b9dbd-1a6c-4679-916c-626afbb36a43-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f9678ce-0b85-4aec-a754-57a2f4b83aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1009032822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944ac97a-7ba5-4380-aa92-6f6e782b1cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfbdb3dc2b24b298c529f895a8617ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:07Z,use_quota=True,user_id='4899094f4ca549089b9b4a9d1af09920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9880fe88-9102-4d9a-8eda-2c064ffdf7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9880fe88-9102-4d9a-8eda-2c064ffdf7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f466f33f-8dfb-4353-beb3-adb2137ec569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f466f33f-8dfb-4353-beb3-adb2137ec569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944ac97a-7ba5-4380-aa92-6f6e782b1cbf', 'volume_name': 'volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729f2ad8-5056-4152-9674-82c51c956238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729f2ad8-5056-4152-9674-82c51c956238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a1b872-1d8f-44ef-9f8b-ca1411eab8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:07 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Volume 944ac97a-7ba5-4380-aa92-6f6e782b1cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf', 'volume_size': 1}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1009032822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944ac97a-7ba5-4380-aa92-6f6e782b1cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfbdb3dc2b24b298c529f895a8617ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:07Z,use_quota=True,user_id='4899094f4ca549089b9b4a9d1af09920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Creating volume 944ac97a-7ba5-4380-aa92-6f6e782b1cbf {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:47:07 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-965b9dbd-1a6c-4679-916c-626afbb36a43-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:07 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:07 devstack sudo[99743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf 1073741824
Sep 16 08:47:07 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c056219e-7557-4ff1-8d6d-23b3cea9cae7" returned: 0 in 0.436s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Lock "cinder-quobyte-c056219e-7557-4ff1-8d6d-23b3cea9cae7" released by "delete_volume" :: held 1.088s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Performing cascade delete. {{(pid=86261) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-46438b66-4d12-4982-bb02-a5dd8497c7cf-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-46438b66-4d12-4982-bb02-a5dd8497c7cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-quobyte-965b9dbd-1a6c-4679-916c-626afbb36a43" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Created reservations ['cb17c144-62f7-492b-a35b-4ee676574a47', '1fd27f86-dacd-47a9-8ca5-88672dd62c57', '41c31ed9-ab4c-47d9-8d57-5f5fdd0c267d', '7c82911f-64b9-478d-9621-5a32cfd41950'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-965b9dbd-1a6c-4679-916c-626afbb36a43" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-quobyte-46438b66-4d12-4982-bb02-a5dd8497c7cf" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-46438b66-4d12-4982-bb02-a5dd8497c7cf" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Deleting offline snapshot 46438b66-4d12-4982-bb02-a5dd8497c7cf of volume 965b9dbd-1a6c-4679-916c-626afbb36a43 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] snapshot_file for this snap is: volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb941d4f-b244-432e-b3d6-9ec5f1bb66ca]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:08 devstack sudo[99749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:08 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:08 devstack sudo[99747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf
Sep 16 08:47:08 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:08 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf 1073741824" returned: 0 in 0.595s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:08 devstack sudo[99757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf
Sep 16 08:47:08 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:08 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.366s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:08 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Deleted volume successfully.
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2487a08a-a2cb-41b6-ba9c-29b9316c3c4f tempest-ProjectReaderTests-509758448 None] Lock "cinder-c056219e-7557-4ff1-8d6d-23b3cea9cae7-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:08 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf" returned: 0 in 0.484s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-965b9dbd-1a6c-4679-916c-626afbb36a43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c765efa1-233c-4374-bcd0-3fe01c073992]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:08 devstack sudo[99760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43
Sep 16 08:47:08 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:08 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf" returned: 0 in 0.337s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a1b872-1d8f-44ef-9f8b-ca1411eab8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7efef5-a106-4741-af07-f1d59af2ba57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:08 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Volume volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf (944ac97a-7ba5-4380-aa92-6f6e782b1cbf): created successfully
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7efef5-a106-4741-af07-f1d59af2ba57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Flow 'volume_create_manager' (df2f5898-31ab-40c7-8a87-d7c0e9b915ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:08 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-311364c5-d262-4afe-86d6-bfe7a13dbf10 tempest-ProjectReaderTests-167686358 None] Created volume successfully.
Sep 16 08:47:08 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43" returned: 0 in 0.480s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8956cb-385d-4995-a5d9-b70293d62d9e]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:09 devstack sudo[99766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409
Sep 16 08:47:09 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Flow 'volume_create_manager' (ee9a210d-4a95-4fa7-937c-1ac38a63d362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20917e80-edca-482d-9456-ad48f573bebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:09 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20917e80-edca-482d-9456-ad48f573bebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1634412286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a8690e-a800-4b21-9143-d150936d92f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0c8cd7279f47ccaa1ec8a3983cf9c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:09Z,use_quota=True,user_id='3ad4752f105548abac56125df34f61d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d1c987-4ff5-4617-90fd-fba8085b6aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d1c987-4ff5-4617-90fd-fba8085b6aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1658ba-b5ea-4710-95e0-fcd14543ec7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1658ba-b5ea-4710-95e0-fcd14543ec7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a8690e-a800-4b21-9143-d150936d92f6', 'volume_name': 'volume-63a8690e-a800-4b21-9143-d150936d92f6', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6916bfa1-3b2e-4922-b59f-91fcb53ccd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6916bfa1-3b2e-4922-b59f-91fcb53ccd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad314968-b0ab-4e89-9bdb-62ceb64d40ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:09 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Volume 63a8690e-a800-4b21-9143-d150936d92f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a8690e-a800-4b21-9143-d150936d92f6', 'volume_size': 1}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1634412286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a8690e-a800-4b21-9143-d150936d92f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0c8cd7279f47ccaa1ec8a3983cf9c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:09Z,use_quota=True,user_id='3ad4752f105548abac56125df34f61d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Creating volume 63a8690e-a800-4b21-9143-d150936d92f6 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:47:09 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63a8690e-a800-4b21-9143-d150936d92f6 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409" returned: 0 in 0.491s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-965b9dbd-1a6c-4679-916c-626afbb36a43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:47:09 devstack sudo[99771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63a8690e-a800-4b21-9143-d150936d92f6 1073741824
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[00755d22-f285-4982-9fbf-3f6d4344f6c1]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:09 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:09 devstack sudo[99773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf
Sep 16 08:47:09 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Acquiring lock "cinder-944ac97a-7ba5-4380-aa92-6f6e782b1cbf-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Lock "cinder-944ac97a-7ba5-4380-aa92-6f6e782b1cbf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Acquiring lock "cinder-quobyte-944ac97a-7ba5-4380-aa92-6f6e782b1cbf" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Lock "cinder-quobyte-944ac97a-7ba5-4380-aa92-6f6e782b1cbf" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4fd148-f3e6-45f5-bf16-4057a8f147cc]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:10 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf" returned: 0 in 0.512s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-965b9dbd-1a6c-4679-916c-626afbb36a43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:47:10 devstack sudo[99778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf
Sep 16 08:47:10 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[178b6a2d-f516-49a4-b3c5-d896916a3e43]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:10 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63a8690e-a800-4b21-9143-d150936d92f6 1073741824" returned: 0 in 0.604s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63a8690e-a800-4b21-9143-d150936d92f6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:10 devstack sudo[99785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63a8690e-a800-4b21-9143-d150936d92f6
Sep 16 08:47:10 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:10 devstack sudo[99784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43
Sep 16 08:47:10 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:10 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf" returned: 0 in 0.446s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:10 devstack sudo[99792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf
Sep 16 08:47:10 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:10 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63a8690e-a800-4b21-9143-d150936d92f6" returned: 0 in 0.305s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad314968-b0ab-4e89-9bdb-62ceb64d40ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a8690e-a800-4b21-9143-d150936d92f6', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73eced6-3c2b-4e94-bb91-762cd58bae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:10 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Volume volume-63a8690e-a800-4b21-9143-d150936d92f6 (63a8690e-a800-4b21-9143-d150936d92f6): created successfully
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73eced6-3c2b-4e94-bb91-762cd58bae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Flow 'volume_create_manager' (ee9a210d-4a95-4fa7-937c-1ac38a63d362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:10 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a6f1c6e7-6e00-420c-90b3-23ee5a0b8af8 tempest-ProjectReaderTests-509758448 None] Created volume successfully.
Sep 16 08:47:10 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43" returned: 0 in 0.496s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:10 devstack sudo[99798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf
Sep 16 08:47:10 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:10 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-944ac97a-7ba5-4380-aa92-6f6e782b1cbf" returned: 0 in 0.296s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Lock "cinder-quobyte-944ac97a-7ba5-4380-aa92-6f6e782b1cbf" released by "delete_volume" :: held 0.789s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Created reservations ['925227bb-6578-4843-8065-27abeccc2311', '3a71651e-5c88-4648-a43d-aa9ead0b4ffb', '2ec9a757-a4c0-4d1b-9948-ee2118707a6d', '11ac0168-b304-490f-b6e1-38e4586f5a49'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:10 devstack sudo[99803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:10 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:10 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf" returned: 0 in 0.444s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:11 devstack sudo[99806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf
Sep 16 08:47:11 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:11 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.310s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:11 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Deleted volume successfully.
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5e5febf5-d313-45ad-a4d9-d8191a039522 tempest-ProjectReaderTests-167686358 None] Lock "cinder-944ac97a-7ba5-4380-aa92-6f6e782b1cbf-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:11 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.46438b66-4d12-4982-bb02-a5dd8497c7cf" returned: 0 in 0.328s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965b9dbd-1a6c-4679-916c-626afbb36a43 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 -F qcow2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:11 devstack sudo[99810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965b9dbd-1a6c-4679-916c-626afbb36a43 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 -F qcow2
Sep 16 08:47:11 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Acquiring lock "cinder-63a8690e-a800-4b21-9143-d150936d92f6-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Lock "cinder-63a8690e-a800-4b21-9143-d150936d92f6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Acquiring lock "cinder-quobyte-63a8690e-a800-4b21-9143-d150936d92f6" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Lock "cinder-quobyte-63a8690e-a800-4b21-9143-d150936d92f6" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cced88a3-0e5f-4742-a0a2-bc49c5a56dbb]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63a8690e-a800-4b21-9143-d150936d92f6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:11 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965b9dbd-1a6c-4679-916c-626afbb36a43 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 -F qcow2" returned: 0 in 0.358s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-46438b66-4d12-4982-bb02-a5dd8497c7cf" released by "_delete_snapshot" :: held 3.869s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-965b9dbd-1a6c-4679-916c-626afbb36a43" released by "delete_snapshot" :: held 3.908s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:11 devstack sudo[99818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63a8690e-a800-4b21-9143-d150936d92f6
Sep 16 08:47:11 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Flow 'volume_create_manager' (3a166d73-7668-4250-9936-877f69dd095f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d0b1d9-f271-4b3f-bee1-f213ab92f983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d0b1d9-f271-4b3f-bee1-f213ab92f983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1435419968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fa0177-83cf-4cc3-b8a1-93921551d1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2c5f40c84ffb91e5681dbaf13f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:12Z,use_quota=True,user_id='f9e8d8fd9a664a7ebe5c99630ec65947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9db1b49-bd55-4a88-af5d-884a505b5a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9db1b49-bd55-4a88-af5d-884a505b5a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c49b4b-4dee-4aa6-b9ae-c5a92e6974eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c49b4b-4dee-4aa6-b9ae-c5a92e6974eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46fa0177-83cf-4cc3-b8a1-93921551d1ea', 'volume_name': 'volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c832018-4794-4dcb-8fc4-a17e0ad38aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c832018-4794-4dcb-8fc4-a17e0ad38aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9467c8c0-724b-4d47-816e-53e9a57f5e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:11 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Volume 46fa0177-83cf-4cc3-b8a1-93921551d1ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea', 'volume_size': 1}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1435419968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fa0177-83cf-4cc3-b8a1-93921551d1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2c5f40c84ffb91e5681dbaf13f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:12Z,use_quota=True,user_id='f9e8d8fd9a664a7ebe5c99630ec65947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Creating volume 46fa0177-83cf-4cc3-b8a1-93921551d1ea {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:47:11 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:11 devstack sudo[99820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea 1073741824
Sep 16 08:47:11 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Flow 'volume_create_manager' (53e5eabd-9b90-4e22-9975-8a4cad42ed1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbc90eb-c13d-4b62-8733-9942ed603ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbc90eb-c13d-4b62-8733-9942ed603ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480847603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fb9fb8-370f-42ec-945a-e52ac74c9fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfbdb3dc2b24b298c529f895a8617ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:12Z,use_quota=True,user_id='4899094f4ca549089b9b4a9d1af09920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fba7a53-fb43-4c5d-95da-6ea696558e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fba7a53-fb43-4c5d-95da-6ea696558e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c523d7d-ccf7-452c-8d1a-b33e3fd45208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c523d7d-ccf7-452c-8d1a-b33e3fd45208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3fb9fb8-370f-42ec-945a-e52ac74c9fe7', 'volume_name': 'volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc58b59-8d76-4012-827b-0fe4b4ed26e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc58b59-8d76-4012-827b-0fe4b4ed26e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df064ccd-68ed-4902-a8f5-c6300f62d454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:12 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Volume e3fb9fb8-370f-42ec-945a-e52ac74c9fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7', 'volume_size': 1}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Created reservations ['8dadd14e-5009-4f61-bdca-d84d67843b3b', '90ff7de1-f1b4-4543-a29a-33a1a9111d11', '60eeae99-684f-470d-9be4-c86728698a99', 'eacce768-a56a-44f5-965c-dce8349f11bd'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:12 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63a8690e-a800-4b21-9143-d150936d92f6" returned: 0 in 0.449s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63a8690e-a800-4b21-9143-d150936d92f6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:12 devstack sudo[99826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63a8690e-a800-4b21-9143-d150936d92f6
Sep 16 08:47:12 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:12 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Delete snapshot completed successfully.
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-46438b66-4d12-4982-bb02-a5dd8497c7cf-delete_snapshot" released by "delete_snapshot" :: held 4.350s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-ad6f96dd-618c-41a7-b522-c80f3c225409-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-ad6f96dd-618c-41a7-b522-c80f3c225409-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-quobyte-965b9dbd-1a6c-4679-916c-626afbb36a43" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-965b9dbd-1a6c-4679-916c-626afbb36a43" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-quobyte-ad6f96dd-618c-41a7-b522-c80f3c225409" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-ad6f96dd-618c-41a7-b522-c80f3c225409" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Deleting offline snapshot ad6f96dd-618c-41a7-b522-c80f3c225409 of volume 965b9dbd-1a6c-4679-916c-626afbb36a43 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] snapshot_file for this snap is: volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09abe47-9fc4-4771-b613-d33f480ec70e]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:12 devstack sudo[99831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409
Sep 16 08:47:12 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:12 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:12 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea 1073741824" returned: 0 in 0.483s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-63a8690e-a800-4b21-9143-d150936d92f6" returned: 0 in 0.308s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Lock "cinder-quobyte-63a8690e-a800-4b21-9143-d150936d92f6" released by "delete_volume" :: held 0.808s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:12 devstack sudo[99834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea
Sep 16 08:47:12 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Created reservations ['1967fb0f-8a93-4864-bee4-09f6815856d5', 'b4105d2e-b5c0-48d2-a3af-c337224cb3fa', 'eece440d-293b-4789-b66f-445ee4dff430', '4b1e44f2-46ae-4bb8-a45d-1615d1b443a8'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:12 devstack sudo[99838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:12 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:12 devstack sudo[99840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:12 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:12 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409" returned: 0 in 0.483s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-965b9dbd-1a6c-4679-916c-626afbb36a43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:47:12 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea" returned: 0 in 0.334s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.723s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1480847603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fb9fb8-370f-42ec-945a-e52ac74c9fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfbdb3dc2b24b298c529f895a8617ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:12Z,use_quota=True,user_id='4899094f4ca549089b9b4a9d1af09920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Creating volume e3fb9fb8-370f-42ec-945a-e52ac74c9fe7 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:47:12 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedd24c4-3b38-49ec-8680-839489940097]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:12 devstack sudo[99844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7 1073741824
Sep 16 08:47:12 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9467c8c0-724b-4d47-816e-53e9a57f5e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a46950-4878-482b-af3b-ac687405e468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:12 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Volume volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea (46fa0177-83cf-4cc3-b8a1-93921551d1ea): created successfully
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a46950-4878-482b-af3b-ac687405e468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Flow 'volume_create_manager' (3a166d73-7668-4250-9936-877f69dd095f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:12 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8f72a907-07fb-424a-b2f3-203fc113ab43 tempest-VolumesCloneTest-1280011016 None] Created volume successfully.
Sep 16 08:47:12 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.336s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:47:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:47:13 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.414s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:13 devstack sudo[99845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43
Sep 16 08:47:13 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:13 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Deleted volume successfully.
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-69cd226a-5ef2-4f46-8c80-a876b9a17868 tempest-ProjectReaderTests-509758448 None] Lock "cinder-63a8690e-a800-4b21-9143-d150936d92f6-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:13 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43" returned: 0 in 0.556s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:13 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7 1073741824" returned: 0 in 0.592s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:13 devstack sudo[99857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409
Sep 16 08:47:13 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:13 devstack sudo[99859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7
Sep 16 08:47:13 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:13 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7" returned: 0 in 0.300s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df064ccd-68ed-4902-a8f5-c6300f62d454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8644d0d8-8b31-4b55-afbe-a35464f22d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:13 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409" returned: 0 in 0.426s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:13 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Volume volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7 (e3fb9fb8-370f-42ec-945a-e52ac74c9fe7): created successfully
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8644d0d8-8b31-4b55-afbe-a35464f22d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:13 devstack sudo[99866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409
Sep 16 08:47:13 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Flow 'volume_create_manager' (53e5eabd-9b90-4e22-9975-8a4cad42ed1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:13 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-fd632d22-8421-4ba3-a8cb-d7736ca50182 tempest-ProjectReaderTests-167686358 None] Created volume successfully.
Sep 16 08:47:14 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43.ad6f96dd-618c-41a7-b522-c80f3c225409" returned: 0 in 0.336s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-ad6f96dd-618c-41a7-b522-c80f3c225409" released by "_delete_snapshot" :: held 1.978s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-965b9dbd-1a6c-4679-916c-626afbb36a43" released by "delete_snapshot" :: held 2.008s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Created reservations ['790e05b1-fa9b-4703-ab1d-86f41cd4a379', '48dc7707-7045-48d6-bad0-887125572040', '05dc7a31-105a-479e-9a6f-1e74f7c6949e', '1f0fc0eb-d293-4af7-93f0-13665182f746'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=226,cinder:INSERT=88,cinder:UPDATE=309,cinder:DELETE=21 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=208,cinder:INSERT=68,cinder:UPDATE=303,cinder:DELETE=33 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Flow 'volume_create_manager' (8c781af5-0a4e-40b2-9983-5db0a3501a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3573d0-321e-42dc-8808-8efe12eaedf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3573d0-321e-42dc-8808-8efe12eaedf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1979151989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6096e0e8-d4cd-4822-aab3-4b9d43f2b438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2c5f40c84ffb91e5681dbaf13f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=46fa0177-83cf-4cc3-b8a1-93921551d1ea,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:14Z,use_quota=True,user_id='f9e8d8fd9a664a7ebe5c99630ec65947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae86502-cc80-4301-884a-69ad6a1f5818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae86502-cc80-4301-884a-69ad6a1f5818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4429a35-2b61-49bb-a892-c61509ff0324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4429a35-2b61-49bb-a892-c61509ff0324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6096e0e8-d4cd-4822-aab3-4b9d43f2b438', 'volume_name': 'volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438', 'volume_size': 2, 'source_volid': '46fa0177-83cf-4cc3-b8a1-93921551d1ea', 'source_volstatus': 'available'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b366b57-8ea8-40ce-aafe-538bdebbf6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b366b57-8ea8-40ce-aafe-538bdebbf6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e598f020-6d78-4a27-a6aa-5cd3408818d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:14 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Volume 6096e0e8-d4cd-4822-aab3-4b9d43f2b438: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438', 'volume_size': 2, 'source_volid': '46fa0177-83cf-4cc3-b8a1-93921551d1ea', 'source_volstatus': 'available'}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:14 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Cloning volume 46fa0177-83cf-4cc3-b8a1-93921551d1ea to volume 6096e0e8-d4cd-4822-aab3-4b9d43f2b438
Sep 16 08:47:14 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Delete snapshot completed successfully.
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-ad6f96dd-618c-41a7-b522-c80f3c225409-delete_snapshot" released by "delete_snapshot" :: held 2.318s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Snapshots deleted, issuing volume delete {{(pid=86261) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-quobyte-965b9dbd-1a6c-4679-916c-626afbb36a43" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Creating offline snapshot 5b763e19-84b6-4c75-8e5a-b6884c7a22c6 of volume 46fa0177-83cf-4cc3-b8a1-93921551d1ea {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-965b9dbd-1a6c-4679-916c-626afbb36a43" acquired by "delete_volume" :: waited 0.035s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca239dd-8f24-4648-a78e-64d4dbff6605]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2922f50-f380-4651-8591-d20bf0db0dcb]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:14 devstack sudo[99869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea
Sep 16 08:47:14 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:14 devstack sudo[99870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43
Sep 16 08:47:14 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Acquiring lock "cinder-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Lock "cinder-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:14 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Acquiring lock "cinder-quobyte-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43" returned: 0 in 0.430s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:15 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea" returned: 0 in 0.472s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:15 devstack sudo[99880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43
Sep 16 08:47:15 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Lock "cinder-quobyte-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7" acquired by "delete_volume" :: waited 0.049s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:15 devstack sudo[99882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6 1G
Sep 16 08:47:15 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[235606e2-8cae-477f-9726-9a42842341eb]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:15 devstack sudo[99884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7
Sep 16 08:47:15 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:15 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-965b9dbd-1a6c-4679-916c-626afbb36a43" returned: 0 in 0.320s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-965b9dbd-1a6c-4679-916c-626afbb36a43" released by "delete_volume" :: held 0.833s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Created reservations ['b8e04478-3165-4dfc-aec5-9b2e00d5bf08', '7763bd8f-8ffa-4bfe-ad58-95f6233b1a24', '57139188-2a0f-45d6-8f33-9a0daccdebe5', '6cce3878-905c-42c7-b248-d6d9d75c70ac'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:15 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6 1G" returned: 0 in 0.530s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:15 devstack sudo[99894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:15 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:15 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7" returned: 0 in 0.476s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:15 devstack sudo[99896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6
Sep 16 08:47:15 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:15 devstack sudo[99898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7
Sep 16 08:47:15 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:15 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.265s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:15 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Deleted volume successfully.
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ac8f923b-4a9a-4e56-8172-6b9da03511ad tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-965b9dbd-1a6c-4679-916c-626afbb36a43-delete_volume" released by "delete_volume" :: held 8.157s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:15 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7" returned: 0 in 0.271s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Lock "cinder-quobyte-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7" released by "delete_volume" :: held 0.822s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:15 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6" returned: 0 in 0.327s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:15 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6 is being set with open permissions: ugo+rw
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:15 devstack sudo[99905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6
Sep 16 08:47:15 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Created reservations ['3b437c83-d5d6-4f6b-95a0-1bf8fdbe6411', '1782544c-97a2-489e-b8c8-d19abc6007bb', '86d59948-6a2e-4a8c-84e1-f9a387e130bf', '47c9e2c8-e413-440d-9f6f-6cd62851be6d'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:16 devstack sudo[99907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:16 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:16 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6" returned: 0 in 0.260s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:16 devstack sudo[99910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.info
Sep 16 08:47:16 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:16 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.290s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:16 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Deleted volume successfully.
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2fa71cf3-d10c-400b-b991-b82341a063dd tempest-ProjectReaderTests-167686358 None] Lock "cinder-e3fb9fb8-370f-42ec-945a-e52ac74c9fe7-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:16 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.info" returned: 0 in 0.328s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:16 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.info is being set with open permissions: ugo+rw
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:16 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.info
Sep 16 08:47:16 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Flow 'volume_create_manager' (8cfd6bbb-fde7-4254-94c5-5f65811daae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cd209e-59c3-4005-bf70-a050f2222766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cd209e-59c3-4005-bf70-a050f2222766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-199928876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459e1f2d-4a33-43a8-9d6c-fcc34d5fe785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfbdb3dc2b24b298c529f895a8617ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:17Z,use_quota=True,user_id='4899094f4ca549089b9b4a9d1af09920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382888c3-57b7-4d1c-868e-95f0685f6e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382888c3-57b7-4d1c-868e-95f0685f6e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7ac4cf-ace2-420f-a051-d6462a923dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7ac4cf-ace2-420f-a051-d6462a923dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459e1f2d-4a33-43a8-9d6c-fcc34d5fe785', 'volume_name': 'volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64eabf41-d54d-4632-86c0-96b3061eea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64eabf41-d54d-4632-86c0-96b3061eea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668098d8-a2da-4949-8ab8-646c2f220480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:16 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Volume 459e1f2d-4a33-43a8-9d6c-fcc34d5fe785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785', 'volume_size': 1}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:16 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.info" returned: 0 in 0.284s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Acquiring lock "cinder-quobyte-6096e0e8-d4cd-4822-aab3-4b9d43f2b438" by "_copy_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Lock "cinder-quobyte-6096e0e8-d4cd-4822-aab3-4b9d43f2b438" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] snapshot: 5b763e19-84b6-4c75-8e5a-b6884c7a22c6, volume: 6096e0e8-d4cd-4822-aab3-4b9d43f2b438,  {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[936b5eb3-ba6b-4fe7-9c85-647ca52b23f6]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:16 devstack sudo[99917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6
Sep 16 08:47:16 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:17 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6" returned: 0 in 0.404s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2029ae84-f5a1-4a64-8fb6-2b6bdeeb640a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Flow 'volume_create_manager' (e4972e9e-454a-4ea6-bc7e-91b47588b1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff2eb1f-cbd9-4074-af81-851783965bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff2eb1f-cbd9-4074-af81-851783965bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-927944204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f4bf70-c693-4b1c-bbcc-48712233f9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdcb289ec33499492dfac2886da3947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:17Z,use_quota=True,user_id='0af5ab3942584f58ae1a8d512f1a4dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd0a5b9-2972-4292-9a64-3d1c11277c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd0a5b9-2972-4292-9a64-3d1c11277c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:17 devstack sudo[99922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea
Sep 16 08:47:17 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a09e624-bf8e-4467-821c-7f2df251faed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a09e624-bf8e-4467-821c-7f2df251faed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f4bf70-c693-4b1c-bbcc-48712233f9d6', 'volume_name': 'volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d76baa-81a5-4b78-ae58-f0654246d820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d76baa-81a5-4b78-ae58-f0654246d820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff29e892-5220-4b64-abe0-2dec5dce7f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:17 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Volume c9f4bf70-c693-4b1c-bbcc-48712233f9d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6', 'volume_size': 1}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:17 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea" returned: 0 in 0.381s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Creating direct copy from snapshot {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG cinder.utils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Path /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438 not found in is_blk_device check {{(pid=86261) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 08:47:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:17 devstack sudo[99927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438
Sep 16 08:47:17 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:23 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438" returned: 0 in 6.088s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:23 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:47:23 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Converted 1024.00 MB image at 168.16 MB/s
Sep 16 08:47:23 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438 is being set with open permissions: ugo+rw
Sep 16 08:47:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:23 devstack sudo[99941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438
Sep 16 08:47:23 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:24 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438" returned: 0 in 0.253s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Lock "cinder-quobyte-6096e0e8-d4cd-4822-aab3-4b9d43f2b438" released by "_copy_volume_from_snapshot" :: held 7.209s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Acquiring lock "cinder-quobyte-5b763e19-84b6-4c75-8e5a-b6884c7a22c6" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Lock "cinder-quobyte-5b763e19-84b6-4c75-8e5a-b6884c7a22c6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Deleting offline snapshot 5b763e19-84b6-4c75-8e5a-b6884c7a22c6 of volume 46fa0177-83cf-4cc3-b8a1-93921551d1ea {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:47:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] snapshot_file for this snap is: volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:47:24 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c39dde-5e20-4c4e-9377-ddf290982bd2]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:24 devstack sudo[99944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6
Sep 16 08:47:24 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:24 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6" returned: 0 in 0.357s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:47:24 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[004eaa56-9d24-4265-b5a4-f0d46c0757e8]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:24 devstack sudo[99949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea
Sep 16 08:47:24 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:25 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea" returned: 0 in 0.525s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:25 devstack sudo[99954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6
Sep 16 08:47:25 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:25 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6" returned: 0 in 0.327s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:25 devstack sudo[99960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6
Sep 16 08:47:25 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:25 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea.5b763e19-84b6-4c75-8e5a-b6884c7a22c6" returned: 0 in 0.249s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Lock "cinder-quobyte-5b763e19-84b6-4c75-8e5a-b6884c7a22c6" released by "_delete_snapshot" :: held 1.558s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.203s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.961s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-199928876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459e1f2d-4a33-43a8-9d6c-fcc34d5fe785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfbdb3dc2b24b298c529f895a8617ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:17Z,use_quota=True,user_id='4899094f4ca549089b9b4a9d1af09920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Creating volume 459e1f2d-4a33-43a8-9d6c-fcc34d5fe785 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:47:25 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:25 devstack sudo[99963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785 1073741824
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e598f020-6d78-4a27-a6aa-5cd3408818d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438', 'volume_size': 2, 'source_volid': '46fa0177-83cf-4cc3-b8a1-93921551d1ea', 'source_volstatus': 'available'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:25 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafb76d6-b732-4028-8c9d-5256f57c758a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:25 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Volume volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438 (6096e0e8-d4cd-4822-aab3-4b9d43f2b438): created successfully
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafb76d6-b732-4028-8c9d-5256f57c758a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Flow 'volume_create_manager' (8c781af5-0a4e-40b2-9983-5db0a3501a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:25 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4d503865-9601-432b-a7db-159d2519e2e5 tempest-VolumesCloneTest-1280011016 None] Created volume successfully.
Sep 16 08:47:26 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785 1073741824" returned: 0 in 0.432s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:26 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785
Sep 16 08:47:26 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:26 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785" returned: 0 in 0.250s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.945s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-927944204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f4bf70-c693-4b1c-bbcc-48712233f9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdcb289ec33499492dfac2886da3947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:17Z,use_quota=True,user_id='0af5ab3942584f58ae1a8d512f1a4dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Creating volume c9f4bf70-c693-4b1c-bbcc-48712233f9d6 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:47:26 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668098d8-a2da-4949-8ab8-646c2f220480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:26 devstack sudo[99971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 1073741824
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbe994a-d72b-422c-9abc-319bbf1b3373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:26 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:26 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Volume volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785 (459e1f2d-4a33-43a8-9d6c-fcc34d5fe785): created successfully
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbe994a-d72b-422c-9abc-319bbf1b3373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Flow 'volume_create_manager' (8cfd6bbb-fde7-4254-94c5-5f65811daae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:26 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-289a2e75-3a45-484e-82af-d78e4e5eb3c4 tempest-ProjectReaderTests-167686358 None] Created volume successfully.
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Acquiring lock "cinder-6096e0e8-d4cd-4822-aab3-4b9d43f2b438-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Lock "cinder-6096e0e8-d4cd-4822-aab3-4b9d43f2b438-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Acquiring lock "cinder-quobyte-6096e0e8-d4cd-4822-aab3-4b9d43f2b438" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Lock "cinder-quobyte-6096e0e8-d4cd-4822-aab3-4b9d43f2b438" acquired by "delete_volume" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50e743b-5403-4b7c-b0c8-06bf4e17e82b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:26 devstack sudo[99973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438
Sep 16 08:47:26 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:26 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 1073741824" returned: 0 in 0.452s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:26 devstack sudo[99979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6
Sep 16 08:47:26 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:26 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438" returned: 0 in 0.410s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:27 devstack sudo[99984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438
Sep 16 08:47:27 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:27 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6" returned: 0 in 0.260s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff29e892-5220-4b64-abe0-2dec5dce7f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656846b6-bd03-4e7f-9b79-797277d703ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:27 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Volume volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 (c9f4bf70-c693-4b1c-bbcc-48712233f9d6): created successfully
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656846b6-bd03-4e7f-9b79-797277d703ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Flow 'volume_create_manager' (e4972e9e-454a-4ea6-bc7e-91b47588b1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-be463863-e4cb-4d6c-8449-0139d44f62d5 tempest-VolumesDeleteCascade-87239403 None] Created volume successfully.
Sep 16 08:47:27 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6096e0e8-d4cd-4822-aab3-4b9d43f2b438" returned: 0 in 0.251s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Lock "cinder-quobyte-6096e0e8-d4cd-4822-aab3-4b9d43f2b438" released by "delete_volume" :: held 0.709s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Created reservations ['88d60752-4534-42aa-9f50-daf3dbf2cd7b', '89548844-c8b7-4813-9c2e-10ca00bebf59', '7ebafcd2-257b-4b2a-a2f3-c3c12d9792bb', '78bae1b0-c238-4a5c-a2a2-47f48c7446dc'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Acquiring lock "cinder-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:27 devstack sudo[99988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:27 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Lock "cinder-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Acquiring lock "cinder-quobyte-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Lock "cinder-quobyte-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aa036f-e5f0-49d6-97cc-fbb2809a3abe]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:27 devstack sudo[99990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785
Sep 16 08:47:27 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:27 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.268s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Deleted volume successfully.
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-61361d0f-ccdb-4672-b87f-6e344188b67f tempest-VolumesCloneTest-1280011016 None] Lock "cinder-6096e0e8-d4cd-4822-aab3-4b9d43f2b438-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Acquiring lock "cinder-46fa0177-83cf-4cc3-b8a1-93921551d1ea-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Lock "cinder-46fa0177-83cf-4cc3-b8a1-93921551d1ea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Acquiring lock "cinder-quobyte-46fa0177-83cf-4cc3-b8a1-93921551d1ea" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Lock "cinder-quobyte-46fa0177-83cf-4cc3-b8a1-93921551d1ea" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8527d9b3-533f-49ad-8a9e-c167635d5c7c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:27 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785" returned: 0 in 0.411s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:27 devstack sudo[99997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785
Sep 16 08:47:27 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:27 devstack sudo[99994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea
Sep 16 08:47:27 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:28 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785" returned: 0 in 0.259s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Lock "cinder-quobyte-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785" released by "delete_volume" :: held 0.724s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:28 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] Creating offline snapshot 54de9da7-cd81-43ee-b509-701ac6ece486 of volume c9f4bf70-c693-4b1c-bbcc-48712233f9d6 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea" returned: 0 in 0.435s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b69b41-6b27-4bb1-ab48-d88b75ebfa6e]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:28 devstack sudo[100004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea
Sep 16 08:47:28 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Created reservations ['bf7039e5-092b-4f00-87cf-481203a400ab', 'c4f0533b-66bd-43f2-9c33-1abc170685ec', '2dbacb1c-bfe0-4e7b-9e00-096c8fbdb4b4', '6ed07d25-1dc1-49ff-9e27-ddc69e015385'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:28 devstack sudo[100005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6
Sep 16 08:47:28 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:28 devstack sudo[100008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:28 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:28 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-46fa0177-83cf-4cc3-b8a1-93921551d1ea" returned: 0 in 0.330s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Lock "cinder-quobyte-46fa0177-83cf-4cc3-b8a1-93921551d1ea" released by "delete_volume" :: held 0.839s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Created reservations ['c3e395c0-35d6-42b3-8247-55ddb3f9b3b9', '8cc098d5-5606-40dd-aae6-718d62c7efec', '988caf73-70d1-4b8f-8791-7f2a2308928b', '5c84bcd9-3d7e-443b-bdc9-e482ee46d631'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:28 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6" returned: 0 in 0.476s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:28 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:28 devstack sudo[100015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486 1G
Sep 16 08:47:28 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.397s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:28 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Deleted volume successfully.
Sep 16 08:47:28 devstack sudo[100017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:28 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-121b6c8a-cd87-4142-af6b-a7844e5a5e1e tempest-ProjectReaderTests-167686358 None] Lock "cinder-459e1f2d-4a33-43a8-9d6c-fcc34d5fe785-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:29 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.301s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:29 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:29 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Deleted volume successfully.
Sep 16 08:47:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7f1597f0-cfda-4e08-b666-0d19a58e0c41 tempest-VolumesCloneTest-1280011016 None] Lock "cinder-46fa0177-83cf-4cc3-b8a1-93921551d1ea-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:29 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486 1G" returned: 0 in 0.516s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:29 devstack sudo[100024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486
Sep 16 08:47:29 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:29 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486" returned: 0 in 0.321s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:29 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486 is being set with open permissions: ugo+rw
Sep 16 08:47:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:29 devstack sudo[100029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486
Sep 16 08:47:29 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:29 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486" returned: 0 in 0.280s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:29 devstack sudo[100032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.info
Sep 16 08:47:29 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:30 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.info" returned: 0 in 0.325s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:30 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.info is being set with open permissions: ugo+rw
Sep 16 08:47:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:30 devstack sudo[100035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.info
Sep 16 08:47:30 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:30 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.info" returned: 0 in 0.287s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1ba0b484-b84e-40cb-9b54-8c6e4042f8c8 tempest-VolumesDeleteCascade-87239403 None] Create snapshot completed successfully
Sep 16 08:47:31 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:47:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Flow 'volume_create_manager' (60477158-4ec3-4833-b19c-779d1bf928d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942cad72-b37a-4f8b-8e20-cc3ed4d41287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942cad72-b37a-4f8b-8e20-cc3ed4d41287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-768974108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10bba58-4502-4556-b1d7-814cb7c62116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fdcb289ec33499492dfac2886da3947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=54de9da7-cd81-43ee-b509-701ac6ece486,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:32Z,use_quota=True,user_id='0af5ab3942584f58ae1a8d512f1a4dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9ae7c0-1ef4-4be1-af82-864c00835504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9ae7c0-1ef4-4be1-af82-864c00835504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42df7495-12ee-4350-b127-9c44120302fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42df7495-12ee-4350-b127-9c44120302fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b10bba58-4502-4556-b1d7-814cb7c62116', 'volume_name': 'volume-b10bba58-4502-4556-b1d7-814cb7c62116', 'volume_size': 1, 'snapshot_id': '54de9da7-cd81-43ee-b509-701ac6ece486'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c930ccd0-d5af-47f6-9ea2-453d9ba16728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c930ccd0-d5af-47f6-9ea2-453d9ba16728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ebc698-29ec-4540-a538-69a218fde407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:32 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Volume b10bba58-4502-4556-b1d7-814cb7c62116: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b10bba58-4502-4556-b1d7-814cb7c62116', 'volume_size': 1, 'snapshot_id': '54de9da7-cd81-43ee-b509-701ac6ece486'}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-quobyte-54de9da7-cd81-43ee-b509-701ac6ece486-b10bba58-4502-4556-b1d7-814cb7c62116" by "_create_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-54de9da7-cd81-43ee-b509-701ac6ece486-b10bba58-4502-4556-b1d7-814cb7c62116" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Creating volume b10bba58-4502-4556-b1d7-814cb7c62116 from snapshot 54de9da7-cd81-43ee-b509-701ac6ece486 {{(pid=86261) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-quobyte-b10bba58-4502-4556-b1d7-814cb7c62116" by "_copy_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-b10bba58-4502-4556-b1d7-814cb7c62116" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] snapshot: 54de9da7-cd81-43ee-b509-701ac6ece486, volume: b10bba58-4502-4556-b1d7-814cb7c62116,  {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf50c1a8-45d6-4cba-87c6-dfe789881939]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:32 devstack sudo[100039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486
Sep 16 08:47:32 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:32 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486" returned: 0 in 0.376s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe432a6-38c0-4352-9b81-efa64dadc29f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:32 devstack sudo[100045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6
Sep 16 08:47:32 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:32 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6" returned: 0 in 0.397s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Creating direct copy from snapshot {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG cinder.utils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Path /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116 not found in is_blk_device check {{(pid=86261) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 08:47:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:32 devstack sudo[100050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116
Sep 16 08:47:32 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Flow 'volume_create_manager' (8e27ee90-622b-46e9-b324-b49d4e73583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9edcfa56-e15b-47f2-81d1-d74a17f42a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9edcfa56-e15b-47f2-81d1-d74a17f42a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1787670790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04012f37-2212-41e5-9a62-2a1a9c28cd19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e479e720ec440bb0151b07037b1893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:33Z,use_quota=True,user_id='47d866563992406ab38b3e260b6a3664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31cf3bc-8d26-4385-91a7-c34c724a65ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31cf3bc-8d26-4385-91a7-c34c724a65ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b05ae3-57d0-4292-81be-c2c5f8503835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.image.glance [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Creating Keystone auth plugin from conf {{(pid=86261) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b05ae3-57d0-4292-81be-c2c5f8503835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '04012f37-2212-41e5-9a62-2a1a9c28cd19', 'volume_name': 'volume-04012f37-2212-41e5-9a62-2a1a9c28cd19', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0e4ff1af0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e2bda2-a8b3-4548-a335-26e99a6ecc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e2bda2-a8b3-4548-a335-26e99a6ecc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a61eea-8224-4172-a9e5-72838e673756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:33 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Volume 04012f37-2212-41e5-9a62-2a1a9c28cd19: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-04012f37-2212-41e5-9a62-2a1a9c28cd19', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0e4ff1af0>}
Sep 16 08:47:33 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Trying to clone 04012f37-2212-41e5-9a62-2a1a9c28cd19 from image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]). {{(pid=86261) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 08:47:34 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 08:47:34 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 08:47:34 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87492f2-7b2c-4e90-9229-fe7331439b04]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:34 devstack sudo[100063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD
Sep 16 08:47:34 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:34 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:34 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Temporary image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 is fetched for user 47d866563992406ab38b3e260b6a3664. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 08:47:34 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[67114fe4-644e-421d-9412-8c940631313d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:35 devstack sudo[100069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD
Sep 16 08:47:35 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:35 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD" returned: 0 in 0.632s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:39 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116" returned: 0 in 6.406s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:47:39 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Converted 1024.00 MB image at 159.84 MB/s
Sep 16 08:47:39 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116 is being set with open permissions: ugo+rw
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:39 devstack sudo[100075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116
Sep 16 08:47:39 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:39 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116" returned: 0 in 0.242s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-b10bba58-4502-4556-b1d7-814cb7c62116" released by "_copy_volume_from_snapshot" :: held 7.505s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-54de9da7-cd81-43ee-b509-701ac6ece486-b10bba58-4502-4556-b1d7-814cb7c62116" released by "_create_volume_from_snapshot" :: held 7.569s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.585s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.182s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1787670790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04012f37-2212-41e5-9a62-2a1a9c28cd19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e479e720ec440bb0151b07037b1893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:33Z,use_quota=True,user_id='47d866563992406ab38b3e260b6a3664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Creating volume 04012f37-2212-41e5-9a62-2a1a9c28cd19 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:47:39 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:39 devstack sudo[100080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 1073741824
Sep 16 08:47:39 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ebc698-29ec-4540-a538-69a218fde407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b10bba58-4502-4556-b1d7-814cb7c62116', 'volume_size': 1, 'snapshot_id': '54de9da7-cd81-43ee-b509-701ac6ece486'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23640a8-083e-4539-b7b4-c089ff2c8b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:39 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Volume volume-b10bba58-4502-4556-b1d7-814cb7c62116 (b10bba58-4502-4556-b1d7-814cb7c62116): created successfully
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23640a8-083e-4539-b7b4-c089ff2c8b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Flow 'volume_create_manager' (60477158-4ec3-4833-b19c-779d1bf928d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:39 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-32fce07c-61a7-4135-b858-ba1656f3a3d3 tempest-VolumesDeleteCascade-87239403 None] Created volume successfully.
Sep 16 08:47:40 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 1073741824" returned: 0 in 0.418s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:40 devstack sudo[100085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19
Sep 16 08:47:40 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:40 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19" returned: 0 in 0.241s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Attempting download of 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}])) to volume 04012f37-2212-41e5-9a62-2a1a9c28cd19. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18a1ca2-2ac5-4b36-abb1-bf1f5f017d2e]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_989jg3gk {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:40 devstack sudo[100088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_989jg3gk
Sep 16 08:47:40 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:40 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_989jg3gk" returned: 0 in 0.326s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_989jg3gk {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:40 devstack sudo[100092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_989jg3gk
Sep 16 08:47:40 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-c9f4bf70-c693-4b1c-bbcc-48712233f9d6-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-c9f4bf70-c693-4b1c-bbcc-48712233f9d6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Performing cascade delete. {{(pid=86261) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-54de9da7-cd81-43ee-b509-701ac6ece486-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-54de9da7-cd81-43ee-b509-701ac6ece486-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-quobyte-c9f4bf70-c693-4b1c-bbcc-48712233f9d6" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-c9f4bf70-c693-4b1c-bbcc-48712233f9d6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-quobyte-54de9da7-cd81-43ee-b509-701ac6ece486" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-54de9da7-cd81-43ee-b509-701ac6ece486" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Deleting offline snapshot 54de9da7-cd81-43ee-b509-701ac6ece486 of volume c9f4bf70-c693-4b1c-bbcc-48712233f9d6 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] snapshot_file for this snap is: volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f2a488-66ad-4e80-a529-22482e029e7f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:41 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_989jg3gk" returned: 1 in 0.355s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_989jg3gk' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2864a0-f9b1-47c0-9d2f-532c1a3b5843]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:41 devstack sudo[100096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486
Sep 16 08:47:41 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:41 devstack sudo[100097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD
Sep 16 08:47:41 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:41 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 was qcow2, converting to qcow2 {{(pid=86261) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:41 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486" returned: 0 in 0.395s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:47:41 devstack sudo[100107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19
Sep 16 08:47:41 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a168d9e-52a7-4177-8c2c-59f31b5444f6]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:41 devstack sudo[100109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6
Sep 16 08:47:41 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:42 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6" returned: 0 in 0.567s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:42 devstack sudo[100121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486
Sep 16 08:47:42 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:42 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486" returned: 0 in 0.384s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:42 devstack sudo[100126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486
Sep 16 08:47:42 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:42 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6.54de9da7-cd81-43ee-b509-701ac6ece486" returned: 0 in 0.269s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-54de9da7-cd81-43ee-b509-701ac6ece486" released by "_delete_snapshot" :: held 1.727s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-c9f4bf70-c693-4b1c-bbcc-48712233f9d6" released by "delete_snapshot" :: held 1.752s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Created reservations ['e292c44c-10a7-447b-8a4d-1313265114a9', 'ced30b2c-c88f-42fb-bb2b-c8e44f25813d', 'cc62aac4-5499-4857-8e33-6abb829fa8fd', '795772eb-1843-43da-be32-ebba7d7c617c'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:42 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Delete snapshot completed successfully.
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-54de9da7-cd81-43ee-b509-701ac6ece486-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Snapshots deleted, issuing volume delete {{(pid=86261) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-quobyte-c9f4bf70-c693-4b1c-bbcc-48712233f9d6" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-c9f4bf70-c693-4b1c-bbcc-48712233f9d6" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b0c066-d58e-4f82-a853-4de1c278af57]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:43 devstack sudo[100129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6
Sep 16 08:47:43 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:43 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19" returned: 0 in 1.865s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_6s86n0mcdevstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:47:43 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Converted 112.00 MB image at 59.99 MB/s
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:43 devstack sudo[100133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 1G
Sep 16 08:47:43 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:43 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6" returned: 0 in 0.403s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:43 devstack sudo[100136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6
Sep 16 08:47:43 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:43 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c9f4bf70-c693-4b1c-bbcc-48712233f9d6" returned: 0 in 0.244s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:43 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 1G" returned: 0 in 0.328s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Downloaded image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}])) to volume 04012f37-2212-41e5-9a62-2a1a9c28cd19 successfully. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Temporary image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 for user 47d866563992406ab38b3e260b6a3664 is deleted. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Marking volume 04012f37-2212-41e5-9a62-2a1a9c28cd19 as bootable. {{(pid=86261) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-c9f4bf70-c693-4b1c-bbcc-48712233f9d6" released by "delete_volume" :: held 0.726s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Copying metadata from image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 to 04012f37-2212-41e5-9a62-2a1a9c28cd19. {{(pid=86261) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Creating volume glance metadata for volume 04012f37-2212-41e5-9a62-2a1a9c28cd19 backed by image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86261) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Created reservations ['c2e4f286-1279-4b6f-b18f-9addc689440c', '328ba5be-6304-4e6a-869e-c17775898eb7', '824b6c01-4d9e-441a-b306-a0b8df9fd116', '4bec326a-20a8-4f43-b6c4-3b23b9ea9549'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a61eea-8224-4172-a9e5-72838e673756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04012f37-2212-41e5-9a62-2a1a9c28cd19', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0e4ff1af0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3db458a-2a3c-4485-918d-08287e137682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:43 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Volume volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 (04012f37-2212-41e5-9a62-2a1a9c28cd19): created successfully
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3db458a-2a3c-4485-918d-08287e137682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Flow 'volume_create_manager' (8e27ee90-622b-46e9-b324-b49d4e73583a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:43 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-72526c69-5765-4183-a2f0-f52145b742bc tempest-VolumesExtendTest-213557384 None] Created volume successfully.
Sep 16 08:47:43 devstack sudo[100176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:43 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b74c5b0c-3cff-4d3e-bc90-b9a38430ae90 tempest-VolumesExtendTest-213557384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b74c5b0c-3cff-4d3e-bc90-b9a38430ae90 tempest-VolumesExtendTest-213557384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:44 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.296s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ce40fd-3275-4e09-a5a8-33938884862c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b74c5b0c-3cff-4d3e-bc90-b9a38430ae90 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:44 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Deleted volume successfully.
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b71884c4-e6b9-46b6-8f78-cf84d5553727 tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-c9f4bf70-c693-4b1c-bbcc-48712233f9d6-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:44 devstack sudo[100181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19
Sep 16 08:47:44 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-b10bba58-4502-4556-b1d7-814cb7c62116-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-b10bba58-4502-4556-b1d7-814cb7c62116-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "cinder-quobyte-b10bba58-4502-4556-b1d7-814cb7c62116" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-b10bba58-4502-4556-b1d7-814cb7c62116" acquired by "delete_volume" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93046ae-f124-49fa-be66-ec6cc0ae2c24]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:44 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b74c5b0c-3cff-4d3e-bc90-b9a38430ae90 tempest-VolumesExtendTest-213557384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19" returned: 0 in 0.404s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b74c5b0c-3cff-4d3e-bc90-b9a38430ae90 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 2G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:44 devstack sudo[100183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116
Sep 16 08:47:44 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b74c5b0c-3cff-4d3e-bc90-b9a38430ae90 tempest-VolumesExtendTest-213557384 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 2G" returned: 0 in 0.098s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b74c5b0c-3cff-4d3e-bc90-b9a38430ae90 tempest-VolumesExtendTest-213557384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.532s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:44 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b74c5b0c-3cff-4d3e-bc90-b9a38430ae90 tempest-VolumesExtendTest-213557384 None] Extend volume completed successfully.
Sep 16 08:47:44 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116" returned: 0 in 0.380s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:44 devstack sudo[100195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116
Sep 16 08:47:44 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:45 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b10bba58-4502-4556-b1d7-814cb7c62116" returned: 0 in 0.249s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-quobyte-b10bba58-4502-4556-b1d7-814cb7c62116" released by "delete_volume" :: held 0.672s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Created reservations ['fa644523-3bf0-4154-92a2-02a6d58c2cb0', '234a3b3a-e33c-4e7f-82a5-b9ce3c5e891d', '4d6317f7-79f2-4052-905d-f4de20d811d6', '04e276a0-5abb-4a1e-b7b3-bd5948b23ca1'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:45 devstack sudo[100198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:45 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:45 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.254s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:45 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Deleted volume successfully.
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c79907d3-5cad-4416-850f-1eeda96c48fc tempest-VolumesDeleteCascade-87239403 None] Lock "cinder-b10bba58-4502-4556-b1d7-814cb7c62116-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Acquiring lock "cinder-04012f37-2212-41e5-9a62-2a1a9c28cd19-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Lock "cinder-04012f37-2212-41e5-9a62-2a1a9c28cd19-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Acquiring lock "cinder-quobyte-04012f37-2212-41e5-9a62-2a1a9c28cd19" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Lock "cinder-quobyte-04012f37-2212-41e5-9a62-2a1a9c28cd19" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[11187bed-f3f3-47a0-ae8d-1818ca4ed309]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:45 devstack sudo[100201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19
Sep 16 08:47:45 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:46 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19" returned: 0 in 0.389s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:46 devstack sudo[100206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19
Sep 16 08:47:46 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:46 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-04012f37-2212-41e5-9a62-2a1a9c28cd19" returned: 0 in 0.252s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Lock "cinder-quobyte-04012f37-2212-41e5-9a62-2a1a9c28cd19" released by "delete_volume" :: held 0.694s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Created reservations ['357108e8-2401-4142-a3c8-3f202b06d0de', '8badc25b-e04c-4bfd-bbf8-dad30a439b35', '6c13e5e8-6d0d-42d1-b0b9-b388aca72c0e', '701d72a1-59dc-47f5-9bdc-bcabe09b6187'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:46 devstack sudo[100209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:46 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:46 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.272s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:46 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Deleted volume successfully.
Sep 16 08:47:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44eebfa7-0d32-46af-a5d4-581523c07988 tempest-VolumesExtendTest-213557384 None] Lock "cinder-04012f37-2212-41e5-9a62-2a1a9c28cd19-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Flow 'volume_create_manager' (a5263fc4-e28f-41ab-92c1-a81fe91015e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d489a5b-de85-4ba2-a7a0-ba77a8d9ce81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d489a5b-de85-4ba2-a7a0-ba77a8d9ce81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1399590677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3086285a-9728-4824-a974-a2b53fa930e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e479e720ec440bb0151b07037b1893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:47Z,use_quota=True,user_id='47d866563992406ab38b3e260b6a3664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126a5c37-c9c5-4e5e-8ff3-a4799f177fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126a5c37-c9c5-4e5e-8ff3-a4799f177fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d96d05-0b0e-432d-b854-589270994d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d96d05-0b0e-432d-b854-589270994d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3086285a-9728-4824-a974-a2b53fa930e5', 'volume_name': 'volume-3086285a-9728-4824-a974-a2b53fa930e5', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7338943-f186-4ec6-9991-dbd60e9223c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7338943-f186-4ec6-9991-dbd60e9223c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd0550e-9922-4847-9212-4bdb49dabbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:47 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Volume 3086285a-9728-4824-a974-a2b53fa930e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3086285a-9728-4824-a974-a2b53fa930e5', 'volume_size': 1}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1399590677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3086285a-9728-4824-a974-a2b53fa930e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e479e720ec440bb0151b07037b1893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:47:47Z,use_quota=True,user_id='47d866563992406ab38b3e260b6a3664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Creating volume 3086285a-9728-4824-a974-a2b53fa930e5 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:47:47 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:47 devstack sudo[100212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5 1073741824
Sep 16 08:47:47 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:47 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5 1073741824" returned: 0 in 0.437s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:47 devstack sudo[100218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5
Sep 16 08:47:47 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:48 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5" returned: 0 in 0.259s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd0550e-9922-4847-9212-4bdb49dabbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3086285a-9728-4824-a974-a2b53fa930e5', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5898302a-bf68-4082-a9c3-1067b2f064ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:47:48 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Volume volume-3086285a-9728-4824-a974-a2b53fa930e5 (3086285a-9728-4824-a974-a2b53fa930e5): created successfully
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5898302a-bf68-4082-a9c3-1067b2f064ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Flow 'volume_create_manager' (a5263fc4-e28f-41ab-92c1-a81fe91015e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:47:48 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2243fad4-c0b2-4d7e-9de9-68e2062df8d2 tempest-VolumesExtendTest-213557384 None] Created volume successfully.
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] Creating offline snapshot 538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 of volume 3086285a-9728-4824-a974-a2b53fa930e5 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e8860b-3bf0-4a88-b930-0de754f73229]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:48 devstack sudo[100221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5
Sep 16 08:47:48 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:48 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5" returned: 0 in 0.415s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:48 devstack sudo[100227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 1G
Sep 16 08:47:48 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:49 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 1G" returned: 0 in 0.489s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3086285a-9728-4824-a974-a2b53fa930e5 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:49 devstack sudo[100233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3086285a-9728-4824-a974-a2b53fa930e5 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5
Sep 16 08:47:49 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:49 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3086285a-9728-4824-a974-a2b53fa930e5 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5" returned: 0 in 0.323s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:49 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 is being set with open permissions: ugo+rw
Sep 16 08:47:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:49 devstack sudo[100241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5
Sep 16 08:47:49 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:49 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5" returned: 0 in 0.259s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:50 devstack sudo[100244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.info
Sep 16 08:47:50 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:50 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.info" returned: 0 in 0.259s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:50 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.info is being set with open permissions: ugo+rw
Sep 16 08:47:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:50 devstack sudo[100247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.info
Sep 16 08:47:50 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:50 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.info" returned: 0 in 0.271s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8aaf78ff-ca5a-4d2d-ba2d-56bb6397a620 tempest-VolumesExtendTest-213557384 None] Create snapshot completed successfully
Sep 16 08:47:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ecd8797f-ab0a-4c07-a416-48d0a609bbd8 tempest-VolumesExtendTest-213557384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ecd8797f-ab0a-4c07-a416-48d0a609bbd8 tempest-VolumesExtendTest-213557384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:51 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a57ff9-45fd-4169-ba9c-76209dc3832f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ecd8797f-ab0a-4c07-a416-48d0a609bbd8 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:51 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5
Sep 16 08:47:51 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:52 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ecd8797f-ab0a-4c07-a416-48d0a609bbd8 tempest-VolumesExtendTest-213557384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5" returned: 0 in 0.390s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ecd8797f-ab0a-4c07-a416-48d0a609bbd8 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 2G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ecd8797f-ab0a-4c07-a416-48d0a609bbd8 tempest-VolumesExtendTest-213557384 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 2G" returned: 0 in 0.149s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ecd8797f-ab0a-4c07-a416-48d0a609bbd8 tempest-VolumesExtendTest-213557384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.580s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:52 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ecd8797f-ab0a-4c07-a416-48d0a609bbd8 tempest-VolumesExtendTest-213557384 None] Extend volume completed successfully.
Sep 16 08:47:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Acquiring lock "cinder-538c3bfd-5e7d-46f3-b4d7-f5385bef1db5-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Lock "cinder-538c3bfd-5e7d-46f3-b4d7-f5385bef1db5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Acquiring lock "cinder-quobyte-3086285a-9728-4824-a974-a2b53fa930e5" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Lock "cinder-quobyte-3086285a-9728-4824-a974-a2b53fa930e5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Acquiring lock "cinder-quobyte-538c3bfd-5e7d-46f3-b4d7-f5385bef1db5" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Lock "cinder-quobyte-538c3bfd-5e7d-46f3-b4d7-f5385bef1db5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Deleting offline snapshot 538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 of volume 3086285a-9728-4824-a974-a2b53fa930e5 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:47:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] snapshot_file for this snap is: volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:47:53 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a30b517-217e-4998-8207-2d4f3d4cdb19]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:53 devstack sudo[100260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5
Sep 16 08:47:53 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:53 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5" returned: 0 in 0.410s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3086285a-9728-4824-a974-a2b53fa930e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:47:53 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[969b27c6-b547-493e-9589-2543f5100dd7]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:53 devstack sudo[100266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5
Sep 16 08:47:53 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:53 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5" returned: 0 in 0.392s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:53 devstack sudo[100272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5
Sep 16 08:47:53 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:54 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5" returned: 0 in 0.384s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:54 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5
Sep 16 08:47:54 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:54 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5.538c3bfd-5e7d-46f3-b4d7-f5385bef1db5" returned: 0 in 0.256s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Lock "cinder-quobyte-538c3bfd-5e7d-46f3-b4d7-f5385bef1db5" released by "_delete_snapshot" :: held 1.577s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Lock "cinder-quobyte-3086285a-9728-4824-a974-a2b53fa930e5" released by "delete_snapshot" :: held 1.600s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:54 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Created reservations ['e578f945-e90e-431e-98cb-b55b8cb62646', '05962d38-c134-47f5-83b7-e03f12bff7a3', '27b2fef7-1edf-4875-98b3-08453fb99fba', '9e22b1a6-e4ba-4941-9e6e-8d8394094ff2'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:54 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Delete snapshot completed successfully.
Sep 16 08:47:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-32e7b4e5-c4b8-43ff-950c-d3024a29cc65 tempest-VolumesExtendTest-213557384 None] Lock "cinder-538c3bfd-5e7d-46f3-b4d7-f5385bef1db5-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Acquiring lock "cinder-3086285a-9728-4824-a974-a2b53fa930e5-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Lock "cinder-3086285a-9728-4824-a974-a2b53fa930e5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Acquiring lock "cinder-quobyte-3086285a-9728-4824-a974-a2b53fa930e5" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:47:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Lock "cinder-quobyte-3086285a-9728-4824-a974-a2b53fa930e5" acquired by "delete_volume" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:47:55 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3d7745-1253-4b7c-866b-6a1c21deabe2]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:47:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:55 devstack sudo[100286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5
Sep 16 08:47:55 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:55 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5" returned: 0 in 0.378s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:55 devstack sudo[100291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5
Sep 16 08:47:55 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:55 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3086285a-9728-4824-a974-a2b53fa930e5" returned: 0 in 0.271s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Lock "cinder-quobyte-3086285a-9728-4824-a974-a2b53fa930e5" released by "delete_volume" :: held 0.753s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:47:56 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Created reservations ['8ac407ea-6daa-4004-84a0-55c9a9b12e04', '3d5e488d-4819-4eb7-8d16-d2cca29beaff', 'a7d4d11d-bb69-4431-81b8-d9503f3af49c', '27040756-4270-4872-9770-05cc0ca82584'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:47:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:47:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:47:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:47:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:47:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:47:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:47:56 devstack sudo[100294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:47:56 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:47:56 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root
Sep 16 08:47:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.351s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:47:56 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:47:56 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Deleted volume successfully.
Sep 16 08:47:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-be61228b-5acc-4773-b570-2411359ef051 tempest-VolumesExtendTest-213557384 None] Lock "cinder-3086285a-9728-4824-a974-a2b53fa930e5-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Flow 'volume_create_manager' (395bc6a3-8c72-420b-9979-aba1f1584139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59fcc89-585e-4a12-874a-e2937fe1dd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59fcc89-585e-4a12-874a-e2937fe1dd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1461127867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93315b64-4704-4924-82af-98525f6ff8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711fe2305e9046ac8faf97e2fdff62bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:48:01Z,use_quota=True,user_id='6fe18bbe5ef9403dbeeafe2aa2288e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec2e860-d1b3-42c9-9325-dd7f310206fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec2e860-d1b3-42c9-9325-dd7f310206fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e01455b-5171-4181-aa05-589499c9c36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e01455b-5171-4181-aa05-589499c9c36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93315b64-4704-4924-82af-98525f6ff8fe', 'volume_name': 'volume-93315b64-4704-4924-82af-98525f6ff8fe', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb13aed9-74a9-4a95-acf4-d14bdfbbf2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb13aed9-74a9-4a95-acf4-d14bdfbbf2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0f5351-ec75-490e-8b50-e3fdeba9b628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:48:01 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Volume 93315b64-4704-4924-82af-98525f6ff8fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93315b64-4704-4924-82af-98525f6ff8fe', 'volume_size': 1}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1461127867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93315b64-4704-4924-82af-98525f6ff8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711fe2305e9046ac8faf97e2fdff62bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:48:01Z,use_quota=True,user_id='6fe18bbe5ef9403dbeeafe2aa2288e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Creating volume 93315b64-4704-4924-82af-98525f6ff8fe {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:48:01 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:01 devstack sudo[100297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe 1073741824
Sep 16 08:48:01 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:01 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe 1073741824" returned: 0 in 0.471s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:01 devstack sudo[100304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe
Sep 16 08:48:01 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:01 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe" returned: 0 in 0.260s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0f5351-ec75-490e-8b50-e3fdeba9b628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93315b64-4704-4924-82af-98525f6ff8fe', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:48:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbf9cb5-1580-4f48-84cc-bc56af230e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:48:02 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Volume volume-93315b64-4704-4924-82af-98525f6ff8fe (93315b64-4704-4924-82af-98525f6ff8fe): created successfully
Sep 16 08:48:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbf9cb5-1580-4f48-84cc-bc56af230e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:48:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Flow 'volume_create_manager' (395bc6a3-8c72-420b-9979-aba1f1584139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:48:02 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-fb24e014-3977-457e-8636-2af2fb4b2aac tempest-VolumesActionsTest-389014412 None] Created volume successfully.
Sep 16 08:48:12 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=124,cinder:SELECT=74,cinder:INSERT=36,cinder:DELETE=9 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:48:12 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=115,cinder:SELECT=111,cinder:INSERT=32,cinder:DELETE=9 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:48:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:48:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:48:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:48:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:48:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:48:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:48:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:12 devstack sudo[100395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:48:12 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:13 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.378s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:48:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:48:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:48:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:48:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1d435a83-862a-4820-ba52-b4a46d982bcb tempest-VolumesActionsTest-389014412 None] Acquiring lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe" by "attach_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:48:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1d435a83-862a-4820-ba52-b4a46d982bcb tempest-VolumesActionsTest-389014412 None] Lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe" acquired by "attach_volume" :: waited 0.036s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:48:14 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1d435a83-862a-4820-ba52-b4a46d982bcb tempest-VolumesActionsTest-389014412 None] Attaching volume 93315b64-4704-4924-82af-98525f6ff8fe to instance 81b7103d-7a6b-44c1-a71a-4b7d650b1cdf at mountpoint /dev/vdb on host None.
Sep 16 08:48:14 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1d435a83-862a-4820-ba52-b4a46d982bcb tempest-VolumesActionsTest-389014412 None] Attach volume completed successfully.
Sep 16 08:48:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1d435a83-862a-4820-ba52-b4a46d982bcb tempest-VolumesActionsTest-389014412 None] Lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe" released by "attach_volume" :: held 0.120s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:48:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d3689b8e-988c-4f5c-8d9e-2311a7925ff6 tempest-VolumesActionsTest-389014412 None] Acquiring lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe-detach_volume" by "detach_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:48:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d3689b8e-988c-4f5c-8d9e-2311a7925ff6 tempest-VolumesActionsTest-389014412 None] Lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:48:15 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d3689b8e-988c-4f5c-8d9e-2311a7925ff6 tempest-VolumesActionsTest-389014412 None] Detaching volume 93315b64-4704-4924-82af-98525f6ff8fe from instance 81b7103d-7a6b-44c1-a71a-4b7d650b1cdf.
Sep 16 08:48:15 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d3689b8e-988c-4f5c-8d9e-2311a7925ff6 tempest-VolumesActionsTest-389014412 None] Detach volume completed successfully.
Sep 16 08:48:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d3689b8e-988c-4f5c-8d9e-2311a7925ff6 tempest-VolumesActionsTest-389014412 None] Lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Flow 'volume_create_manager' (e11dca00-584e-4b9c-8318-176eee6f2e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c914e602-b575-4b85-98d5-35775a10c6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c914e602-b575-4b85-98d5-35775a10c6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-46514642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c15499-e891-4d3e-a00b-4f3eb3628a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900934eb9bcc46f6bee5b4e2e5e7cee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:48:22Z,use_quota=True,user_id='5cd05b01bd654bafada37ab1c56f7c00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd713f6-bd64-403c-bee8-8bf2d8259498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd713f6-bd64-403c-bee8-8bf2d8259498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58b929c-8854-4bc6-a885-329b0aec13b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.image.glance [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Creating Keystone auth plugin from conf {{(pid=86261) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58b929c-8854-4bc6-a885-329b0aec13b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '72c15499-e891-4d3e-a00b-4f3eb3628a3c', 'volume_name': 'volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef1cbd70>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3bafd2-2fcb-4323-b55b-e5ee7cf7d115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3bafd2-2fcb-4323-b55b-e5ee7cf7d115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c25b5e8-48ed-4ba4-a629-572418e8be63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:48:22 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Volume 72c15499-e891-4d3e-a00b-4f3eb3628a3c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef1cbd70>}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Trying to clone 72c15499-e891-4d3e-a00b-4f3eb3628a3c from image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]). {{(pid=86261) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 08:48:22 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c9a88d-6fb1-463a-b755-5bda6ef20bcf]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:48:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:22 devstack sudo[100447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD
Sep 16 08:48:22 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:23 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Temporary image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 is fetched for user 5cd05b01bd654bafada37ab1c56f7c00. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e337010e-d71a-4062-a9ce-23274dcf5ed5]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:23 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD
Sep 16 08:48:23 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:23 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-46514642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c15499-e891-4d3e-a00b-4f3eb3628a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900934eb9bcc46f6bee5b4e2e5e7cee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:48:22Z,use_quota=True,user_id='5cd05b01bd654bafada37ab1c56f7c00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Creating volume 72c15499-e891-4d3e-a00b-4f3eb3628a3c {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:48:23 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:48:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:23 devstack sudo[100497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c 1073741824
Sep 16 08:48:23 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:24 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c 1073741824" returned: 0 in 0.804s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:24 devstack sudo[100533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c
Sep 16 08:48:24 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:24 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c" returned: 0 in 0.269s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:48:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:48:25 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Attempting download of 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}])) to volume 72c15499-e891-4d3e-a00b-4f3eb3628a3c. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 08:48:25 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e1d618-7316-4177-9a41-8cdeb3d48b4d]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:48:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_26xtt9gc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:25 devstack sudo[100536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_26xtt9gc
Sep 16 08:48:25 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:25 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_26xtt9gc" returned: 0 in 0.406s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_26xtt9gc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:25 devstack sudo[100542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_26xtt9gc
Sep 16 08:48:25 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:25 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_26xtt9gc" returned: 1 in 0.337s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_26xtt9gc' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:48:25 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e20b9a-3f74-43ab-bd61-8824e43e813d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:48:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:25 devstack sudo[100546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD
Sep 16 08:48:25 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44f0d8d2-0371-4783-8439-14f643f5d6cf tempest-VolumesActionsTest-389014412 None] Acquiring lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe" by "attach_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:48:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44f0d8d2-0371-4783-8439-14f643f5d6cf tempest-VolumesActionsTest-389014412 None] Lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe" acquired by "attach_volume" :: waited 0.025s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:48:26 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:26 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 was qcow2, converting to qcow2 {{(pid=86261) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 08:48:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:26 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-44f0d8d2-0371-4783-8439-14f643f5d6cf tempest-VolumesActionsTest-389014412 None] Attaching volume 93315b64-4704-4924-82af-98525f6ff8fe to instance 0c7e526d-e152-473b-937e-3dc873b29c12 at mountpoint /dev/vdb on host None.
Sep 16 08:48:26 devstack sudo[100552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c
Sep 16 08:48:26 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:26 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-44f0d8d2-0371-4783-8439-14f643f5d6cf tempest-VolumesActionsTest-389014412 None] Attach volume completed successfully.
Sep 16 08:48:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44f0d8d2-0371-4783-8439-14f643f5d6cf tempest-VolumesActionsTest-389014412 None] Lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe" released by "attach_volume" :: held 0.155s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:48:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cc9bb74d-8886-457e-a077-f29ad061376f tempest-VolumesActionsTest-389014412 None] Acquiring lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe-detach_volume" by "detach_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:48:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cc9bb74d-8886-457e-a077-f29ad061376f tempest-VolumesActionsTest-389014412 None] Lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:48:26 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-cc9bb74d-8886-457e-a077-f29ad061376f tempest-VolumesActionsTest-389014412 None] Detaching volume 93315b64-4704-4924-82af-98525f6ff8fe from instance 0c7e526d-e152-473b-937e-3dc873b29c12.
Sep 16 08:48:26 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-cc9bb74d-8886-457e-a077-f29ad061376f tempest-VolumesActionsTest-389014412 None] Detach volume completed successfully.
Sep 16 08:48:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cc9bb74d-8886-457e-a077-f29ad061376f tempest-VolumesActionsTest-389014412 None] Lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:48:28 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c" returned: 0 in 2.435s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:28 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_2vr6anirdevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:48:28 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Converted 112.00 MB image at 45.98 MB/s
Sep 16 08:48:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:28 devstack sudo[100584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c 1G
Sep 16 08:48:28 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:29 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c 1G" returned: 0 in 0.375s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:29 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Downloaded image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}])) to volume 72c15499-e891-4d3e-a00b-4f3eb3628a3c successfully. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 08:48:29 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Temporary image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 for user 5cd05b01bd654bafada37ab1c56f7c00 is deleted. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 08:48:29 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Marking volume 72c15499-e891-4d3e-a00b-4f3eb3628a3c as bootable. {{(pid=86261) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 08:48:29 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Copying metadata from image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 to 72c15499-e891-4d3e-a00b-4f3eb3628a3c. {{(pid=86261) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 08:48:29 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Creating volume glance metadata for volume 72c15499-e891-4d3e-a00b-4f3eb3628a3c backed by image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86261) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 08:48:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c25b5e8-48ed-4ba4-a629-572418e8be63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef1cbd70>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:48:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb78c94-38be-4f9a-8388-3fed1d114887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:48:29 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Volume volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c (72c15499-e891-4d3e-a00b-4f3eb3628a3c): created successfully
Sep 16 08:48:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb78c94-38be-4f9a-8388-3fed1d114887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:48:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Flow 'volume_create_manager' (e11dca00-584e-4b9c-8318-176eee6f2e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:48:29 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d42169dc-f639-449c-b45b-622883635df4 tempest-TestShelveInstance-569985484 None] Created volume successfully.
Sep 16 08:48:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:48:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:48:31 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad493fa1-8a73-490a-bfea-edbd2801b72b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:48:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:31 devstack sudo[100594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe
Sep 16 08:48:31 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:31 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe" returned: 0 in 0.440s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:31 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f948e1df-47f5-4a68-9954-5561ecb1ffcc]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:48:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:31 devstack sudo[100600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe
Sep 16 08:48:31 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-387133f3-8a51-4e8e-ad56-9f0baeb46f92 req-8496ebc5-94c2-4425-bb15-f65e98bc4167 tempest-TestShelveInstance-569985484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:48:32 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe" returned: 0 in 0.432s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.c3b7c4c4-3660-4894-8a96-0d2d80845fd8rainjtyt.img {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:32 devstack sudo[100613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.c3b7c4c4-3660-4894-8a96-0d2d80845fd8rainjtyt.img
Sep 16 08:48:32 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:38 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.c3b7c4c4-3660-4894-8a96-0d2d80845fd8rainjtyt.img" returned: 0 in 6.665s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:38 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55b3968-d988-43d6-b268-4176c81dd026]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:48:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:39 devstack sudo[100628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe
Sep 16 08:48:39 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:48:39 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root
Sep 16 08:48:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe" returned: 0 in 0.511s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:48:39 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.c3b7c4c4-3660-4894-8a96-0d2d80845fd8rainjtyt.img {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:48:39 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] Converted 1024.00 MB image at 153.60 MB/s
Sep 16 08:48:39 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] c3b7c4c4-3660-4894-8a96-0d2d80845fd8 was raw, no need to convert to raw {{(pid=86261) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 16 08:48:49 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=26,cinder:UPDATE=8,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:48:49 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=24,cinder:INSERT=9,cinder:UPDATE=13 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:48:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.233s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:48:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] Uploaded volume to glance image-id: c3b7c4c4-3660-4894-8a96-0d2d80845fd8. {{(pid=86261) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 16 08:48:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-387133f3-8a51-4e8e-ad56-9f0baeb46f92 req-8496ebc5-94c2-4425-bb15-f65e98bc4167 tempest-TestShelveInstance-569985484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.359s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:48:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-387133f3-8a51-4e8e-ad56-9f0baeb46f92 req-8496ebc5-94c2-4425-bb15-f65e98bc4167 tempest-TestShelveInstance-569985484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:48:57 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-082dedbd-3005-4424-a148-5083278e66db tempest-VolumesActionsTest-389014412 None] Copy volume to image completed successfully.
Sep 16 08:48:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-387133f3-8a51-4e8e-ad56-9f0baeb46f92 req-8496ebc5-94c2-4425-bb15-f65e98bc4167 tempest-TestShelveInstance-569985484 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76f062d0-1415-4425-b713-42f5c7a2c4e7', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:48:57 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-387133f3-8a51-4e8e-ad56-9f0baeb46f92 req-8496ebc5-94c2-4425-bb15-f65e98bc4167 tempest-TestShelveInstance-569985484 None] attachment_update completed successfully.
Sep 16 08:48:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:48:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:48:59 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fb99a5-dff6-455b-87c1-603206674797]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:48:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:48:59 devstack sudo[101154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe
Sep 16 08:48:59 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:00 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe" returned: 0 in 0.487s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:00 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6a22ed-b8b2-41c8-b5f5-0134991d6740]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:00 devstack sudo[101163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe
Sep 16 08:49:00 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:00 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe" returned: 0 in 0.447s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:00 devstack sudo[101168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img
Sep 16 08:49:00 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:07 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:49:09 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img" returned: 0 in 8.641s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:09 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8087864a-3c66-4396-a92e-aa1bbe88f293]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:09 devstack sudo[101185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe
Sep 16 08:49:09 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:09 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:49:09 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe" returned: 0 in 0.523s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:09 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe, size 1024.00 MB, duration 8.64 sec, destination /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:49:09 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Converted 1024.00 MB image at 118.49 MB/s
Sep 16 08:49:09 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] 97ebe182-c28d-491c-bbad-f329263cc93f was raw, converting to qcow2 {{(pid=86261) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 16 08:49:09 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af65f09-be27-4ae5-b5b3-3c331e5490e1]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:09 devstack sudo[101190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img
Sep 16 08:49:09 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:10 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img" returned: 0 in 0.339s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:10 devstack sudo[101194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img
Sep 16 08:49:10 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:10 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img" returned: 1 in 0.335s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:49:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img /opt/stack/data/cinder/conversion/vol_upload_g5c8s7ta {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:10 devstack sudo[101199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img /opt/stack/data/cinder/conversion/vol_upload_g5c8s7ta
Sep 16 08:49:10 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:10 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img /opt/stack/data/cinder/conversion/vol_upload_g5c8s7ta" returned: 0 in 0.255s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:10 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Image conversion details: src /opt/stack/data/cinder/conversion/93315b64-4704-4924-82af-98525f6ff8fe.temp_image.97ebe182-c28d-491c-bbad-f329263cc93f9verxxaj.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_g5c8s7ta {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:49:10 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 16 08:49:10 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d19b185-100b-4d06-b9a1-f763ccb74ee1]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g5c8s7ta {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:10 devstack sudo[101204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g5c8s7ta
Sep 16 08:49:10 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:11 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g5c8s7ta" returned: 0 in 0.331s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.781s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Uploaded volume to glance image-id: 97ebe182-c28d-491c-bbad-f329263cc93f. {{(pid=86261) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 16 08:49:12 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4fc37df9-4a31-4c54-a7da-30de152ed3f5 tempest-VolumesActionsTest-389014412 None] Copy volume to image completed successfully.
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:12 devstack sudo[101210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:49:12 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:12 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.255s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:49:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Acquiring lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Acquiring lock "cinder-quobyte-93315b64-4704-4924-82af-98525f6ff8fe" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Lock "cinder-quobyte-93315b64-4704-4924-82af-98525f6ff8fe" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[932c7770-fb91-4a5d-8af9-6417dac3e0b6]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:14 devstack sudo[101213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe
Sep 16 08:49:14 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:14 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe" returned: 0 in 0.384s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:14 devstack sudo[101218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe
Sep 16 08:49:14 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:14 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-93315b64-4704-4924-82af-98525f6ff8fe" returned: 0 in 0.255s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Lock "cinder-quobyte-93315b64-4704-4924-82af-98525f6ff8fe" released by "delete_volume" :: held 0.685s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Created reservations ['a5ba6f85-b3d2-40e5-b908-b5f36768ffd4', 'a4055d8b-acf4-4d4e-8503-7cf29b51b8b7', '9f0042a2-edcf-4146-b3bf-04cc00de5cf8', '9b3f0aa0-d960-4489-ab8d-5a9b420df62d'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:14 devstack sudo[101221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:49:14 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:15 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.268s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:15 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:49:15 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Deleted volume successfully.
Sep 16 08:49:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f14d4193-e917-4fb5-b15d-a9a2d2093ed8 tempest-VolumesActionsTest-389014412 None] Lock "cinder-93315b64-4704-4924-82af-98525f6ff8fe-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (abc75830-3618-4782-9c6e-637ccdefbc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01f2687-6994-4c52-a997-e1a244dc6a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01f2687-6994-4c52-a997-e1a244dc6a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-670018971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d25dc22-7459-4666-9ede-ed1d075dfa83,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:22Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7d668e-f117-4106-92a2-fef5c5d60556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7d668e-f117-4106-92a2-fef5c5d60556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1453b1b4-b200-48ff-931a-38be2d549e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1453b1b4-b200-48ff-931a-38be2d549e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d25dc22-7459-4666-9ede-ed1d075dfa83', 'volume_name': 'volume-6d25dc22-7459-4666-9ede-ed1d075dfa83', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a184acc9-4ef3-4367-b6e3-c968452d8836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a184acc9-4ef3-4367-b6e3-c968452d8836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d42d1c-84ae-4015-9c4a-2c500bddb4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:22 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Volume 6d25dc22-7459-4666-9ede-ed1d075dfa83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d25dc22-7459-4666-9ede-ed1d075dfa83', 'volume_size': 1}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-670018971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d25dc22-7459-4666-9ede-ed1d075dfa83,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:22Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Creating volume 6d25dc22-7459-4666-9ede-ed1d075dfa83 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:49:22 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6d25dc22-7459-4666-9ede-ed1d075dfa83 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:22 devstack sudo[101267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6d25dc22-7459-4666-9ede-ed1d075dfa83 1073741824
Sep 16 08:49:22 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:22 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6d25dc22-7459-4666-9ede-ed1d075dfa83 1073741824" returned: 0 in 0.420s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6d25dc22-7459-4666-9ede-ed1d075dfa83 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:22 devstack sudo[101272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6d25dc22-7459-4666-9ede-ed1d075dfa83
Sep 16 08:49:22 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:23 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6d25dc22-7459-4666-9ede-ed1d075dfa83" returned: 0 in 0.241s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:49:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d42d1c-84ae-4015-9c4a-2c500bddb4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d25dc22-7459-4666-9ede-ed1d075dfa83', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ba567d-5974-4ae1-8fe0-819d69dc6ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:23 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Volume volume-6d25dc22-7459-4666-9ede-ed1d075dfa83 (6d25dc22-7459-4666-9ede-ed1d075dfa83): created successfully
Sep 16 08:49:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ba567d-5974-4ae1-8fe0-819d69dc6ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (abc75830-3618-4782-9c6e-637ccdefbc02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:23 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f22b13d0-e5c5-4984-b13d-d4897889904a tempest-VolumesGetTest-467533173 None] Created volume successfully.
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (a3586e3a-16c7-4e88-b607-fdf1e7211cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fafd1e8-b55c-46df-9696-1556a318dbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fafd1e8-b55c-46df-9696-1556a318dbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-576065853',display_name='tempest-VolumesGetTest-Volume-869158067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ca77aa-db70-4449-9a6a-2aea78aec5f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:24Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1c7f36-9609-42d8-9617-166b3abf05cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1c7f36-9609-42d8-9617-166b3abf05cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409cd9c0-ee82-44a6-959a-f27a31ee0117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409cd9c0-ee82-44a6-959a-f27a31ee0117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ca77aa-db70-4449-9a6a-2aea78aec5f0', 'volume_name': 'volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af89929-a2ad-4506-a10e-d2efd71ae023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af89929-a2ad-4506-a10e-d2efd71ae023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd2e071-e336-4fbe-9708-9566e19943b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:24 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Volume 10ca77aa-db70-4449-9a6a-2aea78aec5f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0', 'volume_size': 1}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-576065853',display_name='tempest-VolumesGetTest-Volume-869158067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ca77aa-db70-4449-9a6a-2aea78aec5f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:24Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Creating volume 10ca77aa-db70-4449-9a6a-2aea78aec5f0 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:49:24 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:24 devstack sudo[101275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0 1073741824
Sep 16 08:49:24 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:24 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0 1073741824" returned: 0 in 0.477s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:24 devstack sudo[101281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0
Sep 16 08:49:24 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:24 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0" returned: 0 in 0.253s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd2e071-e336-4fbe-9708-9566e19943b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6048d984-d5bd-4436-acd5-172f18331037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:24 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Volume volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0 (10ca77aa-db70-4449-9a6a-2aea78aec5f0): created successfully
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6048d984-d5bd-4436-acd5-172f18331037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:24 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (a3586e3a-16c7-4e88-b607-fdf1e7211cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:25 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d2fe5996-6e30-4d06-ab17-d5ada1a67409 tempest-VolumesGetTest-467533173 None] Created volume successfully.
Sep 16 08:49:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-10ca77aa-db70-4449-9a6a-2aea78aec5f0-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Lock "cinder-10ca77aa-db70-4449-9a6a-2aea78aec5f0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-quobyte-10ca77aa-db70-4449-9a6a-2aea78aec5f0" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-10ca77aa-db70-4449-9a6a-2aea78aec5f0" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:26 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[55544f25-e2f4-4ffc-b40c-ab29f7a4beec]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:26 devstack sudo[101284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0
Sep 16 08:49:26 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:26 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0" returned: 0 in 0.394s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:26 devstack sudo[101296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0
Sep 16 08:49:26 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:27 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-10ca77aa-db70-4449-9a6a-2aea78aec5f0" returned: 0 in 0.265s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-10ca77aa-db70-4449-9a6a-2aea78aec5f0" released by "delete_volume" :: held 0.700s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Created reservations ['a5e07394-0cb9-4016-8134-9b418265f167', '6ae6db5e-68f3-4f8b-a668-3e0b05d57397', 'd591d9ce-dce7-4143-b0dd-c0112ff44828', '61634477-b674-4262-a25d-f3416bb6b272'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:27 devstack sudo[101303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:49:27 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:27 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.270s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:49:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Deleted volume successfully.
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-11afc0e1-04f0-406d-bc75-1f363abb02d5 tempest-VolumesGetTest-467533173 None] Lock "cinder-10ca77aa-db70-4449-9a6a-2aea78aec5f0-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-6d25dc22-7459-4666-9ede-ed1d075dfa83-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Lock "cinder-6d25dc22-7459-4666-9ede-ed1d075dfa83-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-quobyte-6d25dc22-7459-4666-9ede-ed1d075dfa83" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-6d25dc22-7459-4666-9ede-ed1d075dfa83" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7006ee4a-e8f3-4f5a-aad2-c44cc2e05397]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6d25dc22-7459-4666-9ede-ed1d075dfa83 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:27 devstack sudo[101308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6d25dc22-7459-4666-9ede-ed1d075dfa83
Sep 16 08:49:27 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:28 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6d25dc22-7459-4666-9ede-ed1d075dfa83" returned: 0 in 0.405s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6d25dc22-7459-4666-9ede-ed1d075dfa83 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:28 devstack sudo[101318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6d25dc22-7459-4666-9ede-ed1d075dfa83
Sep 16 08:49:28 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:28 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-6d25dc22-7459-4666-9ede-ed1d075dfa83" returned: 0 in 0.256s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-6d25dc22-7459-4666-9ede-ed1d075dfa83" released by "delete_volume" :: held 0.718s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Created reservations ['c6cc06a0-1bec-456a-b1fe-58cfb5f77799', '439c9e3e-5f43-43b1-af0f-247ee588565a', 'b1cc3bbc-a466-4778-9729-d283bb01926f', 'ede8e440-45a5-489e-8aa6-e577f5a5d1e9'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:28 devstack sudo[101321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:49:28 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:28 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.264s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:49:28 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Deleted volume successfully.
Sep 16 08:49:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-94c13cf4-cc86-41c0-8ca3-097bb57226c8 tempest-VolumesGetTest-467533173 None] Lock "cinder-6d25dc22-7459-4666-9ede-ed1d075dfa83-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (81f21778-1874-4d56-8244-e153b8fd84ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a20528-e26f-4aad-8aa4-e3e0bc79076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a20528-e26f-4aad-8aa4-e3e0bc79076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-625194184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf688c97-65d6-48c0-b593-9e01cb6441cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:29Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de954140-c7a8-40ea-949c-3c5382880a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de954140-c7a8-40ea-949c-3c5382880a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be0b4c4-a048-45c1-96e5-0580c7b83c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be0b4c4-a048-45c1-96e5-0580c7b83c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf688c97-65d6-48c0-b593-9e01cb6441cc', 'volume_name': 'volume-cf688c97-65d6-48c0-b593-9e01cb6441cc', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f3ec24-a02e-4bca-8cc6-9a93a4c55318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f3ec24-a02e-4bca-8cc6-9a93a4c55318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104369f5-cc77-4987-b893-a65161c6c55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:29 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Volume cf688c97-65d6-48c0-b593-9e01cb6441cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf688c97-65d6-48c0-b593-9e01cb6441cc', 'volume_size': 1}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-625194184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf688c97-65d6-48c0-b593-9e01cb6441cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:29Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Creating volume cf688c97-65d6-48c0-b593-9e01cb6441cc {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:49:29 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:29 devstack sudo[101327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc 1073741824
Sep 16 08:49:29 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:29 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-e29d7559-d8a6-41e7-bb64-803c0ade3a08 req-0a64e6ec-afec-4831-a516-bbd775053ae4 tempest-TestShelveInstance-569985484 None] Terminate volume connection completed successfully.
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-e29d7559-d8a6-41e7-bb64-803c0ade3a08 req-0a64e6ec-afec-4831-a516-bbd775053ae4 tempest-TestShelveInstance-569985484 None] Deleting attachment 76f062d0-1415-4425-b713-42f5c7a2c4e7. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:49:29 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc 1073741824" returned: 0 in 0.592s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:29 devstack sudo[101348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc
Sep 16 08:49:29 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:30 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc" returned: 0 in 0.293s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:49:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104369f5-cc77-4987-b893-a65161c6c55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf688c97-65d6-48c0-b593-9e01cb6441cc', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a8a336-2428-415e-95c5-03c77b94ea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:30 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Volume volume-cf688c97-65d6-48c0-b593-9e01cb6441cc (cf688c97-65d6-48c0-b593-9e01cb6441cc): created successfully
Sep 16 08:49:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a8a336-2428-415e-95c5-03c77b94ea3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (81f21778-1874-4d56-8244-e153b8fd84ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-49d3b9ce-3eb7-48df-90b0-bd9794aee8fe tempest-VolumesGetTest-467533173 None] Created volume successfully.
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (81e33746-b37a-4eb2-b97c-ac3d89a2f373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157de76d-8a81-416f-8572-22016794a3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157de76d-8a81-416f-8572-22016794a3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-923842010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f3e5bc-b25e-49a7-a406-ac46f21f2c3e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=cf688c97-65d6-48c0-b593-9e01cb6441cc,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:32Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a99217f-889e-4ee4-9e01-8112f9d42b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a99217f-889e-4ee4-9e01-8112f9d42b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf52962-2d48-430c-84d4-9365a1aac28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf52962-2d48-430c-84d4-9365a1aac28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '00f3e5bc-b25e-49a7-a406-ac46f21f2c3e', 'volume_name': 'volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e', 'volume_size': 1, 'source_volid': 'cf688c97-65d6-48c0-b593-9e01cb6441cc', 'source_volstatus': 'available'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d66db3-e964-4825-8981-dcf8ba789212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d66db3-e964-4825-8981-dcf8ba789212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f9160f-854f-47a6-a3ea-018b98d122a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:31 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Volume 00f3e5bc-b25e-49a7-a406-ac46f21f2c3e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e', 'volume_size': 1, 'source_volid': 'cf688c97-65d6-48c0-b593-9e01cb6441cc', 'source_volstatus': 'available'}
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:31 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Cloning volume cf688c97-65d6-48c0-b593-9e01cb6441cc to volume 00f3e5bc-b25e-49a7-a406-ac46f21f2c3e
Sep 16 08:49:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Creating offline snapshot f5f97c92-b89b-48c6-8c17-07318236bdd1 of volume cf688c97-65d6-48c0-b593-9e01cb6441cc {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:49:32 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[780ff79b-0cf5-469c-a030-e59dd0e546df]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:32 devstack sudo[101355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc
Sep 16 08:49:32 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-84e80ef3-2bfb-4b4e-86e3-8735e78e426c req-be4cd367-6077-490a-898f-0cd183371a88 tempest-TestShelveInstance-569985484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:32 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc" returned: 0 in 0.396s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:32 devstack sudo[101368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1 1G
Sep 16 08:49:32 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:32 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1 1G" returned: 0 in 0.400s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf688c97-65d6-48c0-b593-9e01cb6441cc -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:32 devstack sudo[101374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf688c97-65d6-48c0-b593-9e01cb6441cc -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1
Sep 16 08:49:32 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:33 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf688c97-65d6-48c0-b593-9e01cb6441cc -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1" returned: 0 in 0.290s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:33 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1 is being set with open permissions: ugo+rw
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:33 devstack sudo[101379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1
Sep 16 08:49:33 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:33 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1" returned: 0 in 0.243s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:33 devstack sudo[101382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.info
Sep 16 08:49:33 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:33 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.info" returned: 0 in 0.288s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:33 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.info is being set with open permissions: ugo+rw
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:33 devstack sudo[101385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.info
Sep 16 08:49:33 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:33 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.info" returned: 0 in 0.243s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-quobyte-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e" by "_copy_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] snapshot: f5f97c92-b89b-48c6-8c17-07318236bdd1, volume: 00f3e5bc-b25e-49a7-a406-ac46f21f2c3e,  {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afbb0bc-9cde-46e1-91e4-6b2ab4103688]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:34 devstack sudo[101388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1
Sep 16 08:49:34 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:34 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1" returned: 0 in 0.363s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf688c97-65d6-48c0-b593-9e01cb6441cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:49:34 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9827d580-a95f-4adc-8d2c-c7181745f78f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:34 devstack sudo[101393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc
Sep 16 08:49:34 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:34 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc" returned: 0 in 0.357s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 08:49:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Creating direct copy from snapshot {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 08:49:34 devstack cinder-volume[86261]: DEBUG cinder.utils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Path /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e not found in is_blk_device check {{(pid=86261) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 08:49:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:34 devstack sudo[101398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e
Sep 16 08:49:34 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:40 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e" returned: 0 in 6.224s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:40 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:49:40 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Converted 1024.00 MB image at 164.48 MB/s
Sep 16 08:49:40 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e is being set with open permissions: ugo+rw
Sep 16 08:49:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:40 devstack sudo[101414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e
Sep 16 08:49:40 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:41 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e" returned: 0 in 0.236s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e" released by "_copy_volume_from_snapshot" :: held 7.246s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-quobyte-f5f97c92-b89b-48c6-8c17-07318236bdd1" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-f5f97c92-b89b-48c6-8c17-07318236bdd1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Deleting offline snapshot f5f97c92-b89b-48c6-8c17-07318236bdd1 of volume cf688c97-65d6-48c0-b593-9e01cb6441cc {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:49:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] snapshot_file for this snap is: volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:49:41 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3387fa-6f60-4e6c-acc2-f875496a446d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:41 devstack sudo[101417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1
Sep 16 08:49:41 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:41 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1" returned: 0 in 0.385s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf688c97-65d6-48c0-b593-9e01cb6441cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:49:41 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1d6b43-612e-4ca2-a948-bc10df5ad1b0]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:41 devstack sudo[101424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc
Sep 16 08:49:41 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:42 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc" returned: 0 in 0.535s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:42 devstack sudo[101429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1
Sep 16 08:49:42 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:42 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1" returned: 0 in 0.335s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:42 devstack sudo[101434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1
Sep 16 08:49:42 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:42 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc.f5f97c92-b89b-48c6-8c17-07318236bdd1" returned: 0 in 0.248s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-f5f97c92-b89b-48c6-8c17-07318236bdd1" released by "_delete_snapshot" :: held 1.615s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.922s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-84e80ef3-2bfb-4b4e-86e3-8735e78e426c req-be4cd367-6077-490a-898f-0cd183371a88 tempest-TestShelveInstance-569985484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.619s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-84e80ef3-2bfb-4b4e-86e3-8735e78e426c req-be4cd367-6077-490a-898f-0cd183371a88 tempest-TestShelveInstance-569985484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f9160f-854f-47a6-a3ea-018b98d122a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e', 'volume_size': 1, 'source_volid': 'cf688c97-65d6-48c0-b593-9e01cb6441cc', 'source_volstatus': 'available'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb35c682-0e2c-4584-9508-f4df711a1104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:42 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Volume volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e (00f3e5bc-b25e-49a7-a406-ac46f21f2c3e): created successfully
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb35c682-0e2c-4584-9508-f4df711a1104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (81e33746-b37a-4eb2-b97c-ac3d89a2f373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-84e80ef3-2bfb-4b4e-86e3-8735e78e426c req-be4cd367-6077-490a-898f-0cd183371a88 tempest-TestShelveInstance-569985484 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23fe338a-44af-4800-8d61-c1d4a0503940', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:49:42 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-70ea3141-8a32-49dd-ae70-f94628991fd3 tempest-VolumesGetTest-467533173 None] Created volume successfully.
Sep 16 08:49:43 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-84e80ef3-2bfb-4b4e-86e3-8735e78e426c req-be4cd367-6077-490a-898f-0cd183371a88 tempest-TestShelveInstance-569985484 None] attachment_update completed successfully.
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (36f343b5-f900-4f7b-b73e-1daeef99cda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a5eda7-3541-4993-80e9-fa427ffbf403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a5eda7-3541-4993-80e9-fa427ffbf403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-308649214',display_name='tempest-VolumesGetTest-Volume-1417733038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb8c15f-6cd0-4e74-a389-1aab8d29055a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:44Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb9c69f-ec76-49ad-8e3c-0f58e1574314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb9c69f-ec76-49ad-8e3c-0f58e1574314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9570d2ce-64ca-4572-aa66-ca51cb0238ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9570d2ce-64ca-4572-aa66-ca51cb0238ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cb8c15f-6cd0-4e74-a389-1aab8d29055a', 'volume_name': 'volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da614664-bf3c-4861-86cf-b582f6a6c25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da614664-bf3c-4861-86cf-b582f6a6c25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a81ffd-c8d0-410e-89d9-39e1bea70c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:44 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Volume 9cb8c15f-6cd0-4e74-a389-1aab8d29055a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a', 'volume_size': 1}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-308649214',display_name='tempest-VolumesGetTest-Volume-1417733038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb8c15f-6cd0-4e74-a389-1aab8d29055a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:44Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Creating volume 9cb8c15f-6cd0-4e74-a389-1aab8d29055a {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:49:44 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:44 devstack sudo[101437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a 1073741824
Sep 16 08:49:44 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:44 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a 1073741824" returned: 0 in 0.488s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:44 devstack sudo[101480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a
Sep 16 08:49:44 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:45 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a" returned: 0 in 0.275s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:49:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a81ffd-c8d0-410e-89d9-39e1bea70c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6eb4e2-5e3c-467e-89d3-2e41eafe9d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:45 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Volume volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a (9cb8c15f-6cd0-4e74-a389-1aab8d29055a): created successfully
Sep 16 08:49:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6eb4e2-5e3c-467e-89d3-2e41eafe9d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (36f343b5-f900-4f7b-b73e-1daeef99cda2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:45 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9637bacf-720f-4844-ba88-c944c7a26cba tempest-VolumesGetTest-467533173 None] Created volume successfully.
Sep 16 08:49:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-9cb8c15f-6cd0-4e74-a389-1aab8d29055a-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Lock "cinder-9cb8c15f-6cd0-4e74-a389-1aab8d29055a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-quobyte-9cb8c15f-6cd0-4e74-a389-1aab8d29055a" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-9cb8c15f-6cd0-4e74-a389-1aab8d29055a" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:46 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[da733609-bcb7-451b-a251-61a5d1709edb]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:46 devstack sudo[101959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a
Sep 16 08:49:46 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:47 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a" returned: 0 in 0.371s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:47 devstack sudo[101964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a
Sep 16 08:49:47 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:47 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-9cb8c15f-6cd0-4e74-a389-1aab8d29055a" returned: 0 in 0.299s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-9cb8c15f-6cd0-4e74-a389-1aab8d29055a" released by "delete_volume" :: held 0.721s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Created reservations ['ceae5cba-ee06-434e-b267-1039606e5ba4', 'd5cf3bce-fedd-4b41-9eca-ea10927aacb9', 'fdb91e63-b0c8-4e65-a39c-89b072a4316a', '1990513e-7f9a-4bdf-9fd5-7d231da76f29'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:47 devstack sudo[101969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:49:47 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:47 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.289s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:49:47 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Deleted volume successfully.
Sep 16 08:49:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e1efaaf6-3fdc-4ce4-b9d9-d3cdee39bcd1 tempest-VolumesGetTest-467533173 None] Lock "cinder-9cb8c15f-6cd0-4e74-a389-1aab8d29055a-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Lock "cinder-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-quobyte-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9975478-0336-4cc6-b993-2c121d401382]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:48 devstack sudo[101972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e
Sep 16 08:49:48 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:48 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e" returned: 0 in 0.380s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:48 devstack sudo[101977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e
Sep 16 08:49:48 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:48 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e" returned: 0 in 0.284s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e" released by "delete_volume" :: held 0.718s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Created reservations ['deb65dba-a912-4087-b927-67173ecefb9a', 'f299adee-3ca0-4fa1-a30a-a61e1ccc112c', '4482aabe-f0ed-42d6-9ada-e5d88802766e', '3aa348bb-b710-4d71-92a0-1119a76721d4'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:49 devstack sudo[101980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:49:49 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:49 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.283s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:49:49 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Deleted volume successfully.
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-cf688c97-65d6-48c0-b593-9e01cb6441cc-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Lock "cinder-cf688c97-65d6-48c0-b593-9e01cb6441cc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1f9526e9-4d6b-4601-af41-eff1c9dcb8bb tempest-VolumesGetTest-467533173 None] Lock "cinder-00f3e5bc-b25e-49a7-a406-ac46f21f2c3e-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-quobyte-cf688c97-65d6-48c0-b593-9e01cb6441cc" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-cf688c97-65d6-48c0-b593-9e01cb6441cc" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceefd01-6d13-445e-8ab2-e3ecc2a581b3]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:49 devstack sudo[101983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc
Sep 16 08:49:49 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:49 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc" returned: 0 in 0.440s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:49 devstack sudo[101990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc
Sep 16 08:49:49 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:50 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-cf688c97-65d6-48c0-b593-9e01cb6441cc" returned: 0 in 0.292s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-cf688c97-65d6-48c0-b593-9e01cb6441cc" released by "delete_volume" :: held 0.805s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:50 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Created reservations ['a45b0519-747f-4ea7-8cce-ed71281f8363', 'b987c046-c251-47a2-9df1-fa2d09985351', '986b7ba7-a5ba-470f-8dbc-cd920d53dff4', '391ba718-2867-4183-bc5b-5751ab6f51cb'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:49:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:50 devstack sudo[101993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:49:50 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:50 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.294s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:50 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:49:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Deleted volume successfully.
Sep 16 08:49:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4964c1cf-1bcf-4f22-840f-32c3742867f0 tempest-VolumesGetTest-467533173 None] Lock "cinder-cf688c97-65d6-48c0-b593-9e01cb6441cc-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (4eea353e-0611-4e0c-95f7-abd78a119c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410256db-cae2-4299-988e-7b1c573239df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410256db-cae2-4299-988e-7b1c573239df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-306951015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5dd42ed-63c6-492d-8e0a-89a3da7a676e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:51Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fb4266-7f38-4852-a503-4add6bc41354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fb4266-7f38-4852-a503-4add6bc41354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78083ee-6d24-4b95-89fb-ccf8ad7d900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.image.glance [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Creating Keystone auth plugin from conf {{(pid=86261) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78083ee-6d24-4b95-89fb-ccf8ad7d900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd5dd42ed-63c6-492d-8e0a-89a3da7a676e', 'volume_name': 'volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef59fbf0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d869901-bf63-4e6a-bb20-a2df4b7d7eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d869901-bf63-4e6a-bb20-a2df4b7d7eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4425dc-c055-4c29-bec1-fefc080af03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:51 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Volume d5dd42ed-63c6-492d-8e0a-89a3da7a676e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef59fbf0>}
Sep 16 08:49:51 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Trying to clone d5dd42ed-63c6-492d-8e0a-89a3da7a676e from image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]). {{(pid=86261) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 08:49:52 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a794946-c9dc-4692-88a4-e9c8439bcd53]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:52 devstack sudo[101998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD
Sep 16 08:49:52 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:52 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Temporary image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 is fetched for user 8950f216f47e49bab93918e440d63489. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c392dbd-5371-4149-8920-5e3953445bf1]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:52 devstack sudo[102003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD
Sep 16 08:49:52 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:52 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-306951015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5dd42ed-63c6-492d-8e0a-89a3da7a676e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:51Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Creating volume d5dd42ed-63c6-492d-8e0a-89a3da7a676e {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:49:52 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:49:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:52 devstack sudo[102008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e 1073741824
Sep 16 08:49:52 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:53 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e 1073741824" returned: 0 in 0.411s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:53 devstack sudo[102014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e
Sep 16 08:49:53 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:53 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e" returned: 0 in 0.257s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:49:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:53 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Attempting download of 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}])) to volume d5dd42ed-63c6-492d-8e0a-89a3da7a676e. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 08:49:53 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49f9783-78a5-4435-ad14-eb28b34a3b9a]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_j9oio_ni {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:53 devstack sudo[102017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_j9oio_ni
Sep 16 08:49:53 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:53 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_j9oio_ni" returned: 0 in 0.346s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_j9oio_ni {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:54 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_j9oio_ni
Sep 16 08:49:54 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:54 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_j9oio_ni" returned: 1 in 0.340s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_j9oio_ni' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:49:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cf3eb3-7f1f-468e-bb68-81b0de90aa2f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:54 devstack sudo[102031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD
Sep 16 08:49:54 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:54 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:54 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 was qcow2, converting to qcow2 {{(pid=86261) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 08:49:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:54 devstack sudo[102036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e
Sep 16 08:49:54 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:56 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e" returned: 0 in 1.731s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1fa19979-4476-4c52-9f14-f9d4ca0f2be7_30lft28udevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:49:56 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Converted 112.00 MB image at 64.66 MB/s
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:56 devstack sudo[102050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e 1G
Sep 16 08:49:56 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:56 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e 1G" returned: 0 in 0.334s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Downloaded image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 ((None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}])) to volume d5dd42ed-63c6-492d-8e0a-89a3da7a676e successfully. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Temporary image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 for user 8950f216f47e49bab93918e440d63489 is deleted. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Marking volume d5dd42ed-63c6-492d-8e0a-89a3da7a676e as bootable. {{(pid=86261) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Copying metadata from image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 to d5dd42ed-63c6-492d-8e0a-89a3da7a676e. {{(pid=86261) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Creating volume glance metadata for volume d5dd42ed-63c6-492d-8e0a-89a3da7a676e backed by image 1fa19979-4476-4c52-9f14-f9d4ca0f2be7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86261) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4425dc-c055-4c29-bec1-fefc080af03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e', 'volume_size': 1, 'image_id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '477a1a8585b045b5b780633f37d77237', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1fa19979-4476-4c52-9f14-f9d4ca0f2be7', 'created_at': datetime.datetime(2026, 9, 16, 6, 29, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1fa19979-4476-4c52-9f14-f9d4ca0f2be7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef59fbf0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920d7249-328d-40a7-9e33-33b1445392c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:56 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Volume volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e (d5dd42ed-63c6-492d-8e0a-89a3da7a676e): created successfully
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920d7249-328d-40a7-9e33-33b1445392c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (4eea353e-0611-4e0c-95f7-abd78a119c3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:56 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-53f17c58-3500-44d0-9e43-ebcd325cfc9b tempest-VolumesGetTest-467533173 None] Created volume successfully.
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (40702a33-68ad-4294-9e73-1f2802f937d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeba3f1d-617c-409d-87c5-9b0562f84290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeba3f1d-617c-409d-87c5-9b0562f84290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-804473444',display_name='tempest-VolumesGetTest-Volume-860529306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:58Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8044b25-822b-470b-9348-a6748d7507a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8044b25-822b-470b-9348-a6748d7507a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b607bbbe-b828-45b1-93dd-c584671c6212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b607bbbe-b828-45b1-93dd-c584671c6212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c', 'volume_name': 'volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f133de3-7550-4718-963b-aca9fc8c6491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f133de3-7550-4718-963b-aca9fc8c6491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63ee2fa-4b56-4ea3-bf58-931935f3572b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:58 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Volume 8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c', 'volume_size': 1}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:49:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-804473444',display_name='tempest-VolumesGetTest-Volume-860529306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11023dd4e8f4406eb25f6839ce289eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:49:58Z,use_quota=True,user_id='8950f216f47e49bab93918e440d63489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Creating volume 8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:49:58 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:58 devstack sudo[102055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c 1073741824
Sep 16 08:49:58 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:58 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c 1073741824" returned: 0 in 0.419s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:58 devstack sudo[102060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c
Sep 16 08:49:58 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:59 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c" returned: 0 in 0.249s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63ee2fa-4b56-4ea3-bf58-931935f3572b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f03ad6-376c-4f58-8f97-9756742bd3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:49:59 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Volume volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c (8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c): created successfully
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f03ad6-376c-4f58-8f97-9756742bd3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Flow 'volume_create_manager' (40702a33-68ad-4294-9e73-1f2802f937d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:49:59 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c65a0884-72f1-4f17-acbc-298572fc28b8 tempest-VolumesGetTest-467533173 None] Created volume successfully.
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Lock "cinder-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-quobyte-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[15884c1b-b189-4c2d-a168-d78739384ca6]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:49:59 devstack sudo[102063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c
Sep 16 08:49:59 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:49:59 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c" returned: 0 in 0.374s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:49:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:00 devstack sudo[102068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c
Sep 16 08:50:00 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:00 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c" returned: 0 in 0.273s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c" released by "delete_volume" :: held 0.689s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Created reservations ['a7b4bb61-cc08-41d8-ad75-9c0f49d93c2d', 'e59fd7ce-c14a-4229-8f61-af473ba4ebd5', '520e7b00-af8a-419a-bab6-b5912b2eedc2', '7ff3764e-3c5b-4599-97ac-3b09358882a7'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:00 devstack sudo[102071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:00 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:00 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.264s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:00 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Deleted volume successfully.
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9ccfaa40-daeb-4e77-a8db-4a0c50fd4021 tempest-VolumesGetTest-467533173 None] Lock "cinder-8b9587ee-3fe3-4aea-a9d6-0d3fe678a55c-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-d5dd42ed-63c6-492d-8e0a-89a3da7a676e-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Lock "cinder-d5dd42ed-63c6-492d-8e0a-89a3da7a676e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Acquiring lock "cinder-quobyte-d5dd42ed-63c6-492d-8e0a-89a3da7a676e" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-d5dd42ed-63c6-492d-8e0a-89a3da7a676e" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[09884b32-29ac-4e33-ba14-f2f5473699e1]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:00 devstack sudo[102074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e
Sep 16 08:50:00 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:01 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e" returned: 0 in 0.386s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:01 devstack sudo[102079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e
Sep 16 08:50:01 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:01 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5dd42ed-63c6-492d-8e0a-89a3da7a676e" returned: 0 in 0.269s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Lock "cinder-quobyte-d5dd42ed-63c6-492d-8e0a-89a3da7a676e" released by "delete_volume" :: held 0.706s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Created reservations ['06f300b5-fa82-46dd-a1cf-fcf0af8cf70b', '417aa1df-44c4-4449-b81a-6347af9be0ad', 'eb230b46-276c-4e06-b216-f7ee4a7d8548', '143e19b4-5a5d-49eb-8677-768f43c3c649'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:01 devstack sudo[102083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:01 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:01 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.271s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:01 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Deleted volume successfully.
Sep 16 08:50:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5b203599-4ff3-465c-8f18-aa6c6ea3aad6 tempest-VolumesGetTest-467533173 None] Lock "cinder-d5dd42ed-63c6-492d-8e0a-89a3da7a676e-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:11 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=79,cinder:UPDATE=92,cinder:INSERT=30,cinder:DELETE=7 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:50:11 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=69,cinder:INSERT=24,cinder:UPDATE=89,cinder:DELETE=8 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:50:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:50:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:12 devstack sudo[102150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:12 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:13 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.396s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:50:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:50:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Flow 'volume_create_manager' (40a9c663-6b82-491f-8562-7a7f4b377665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bc5d94-36d0-4869-a8b9-97b4e18ab7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bc5d94-36d0-4869-a8b9-97b4e18ab7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1596177686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16abd0e4-28ac-4830-87d3-0555d2d0fe0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31de9cb3b0c3426a87d29eef8dccd911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:14Z,use_quota=True,user_id='8f810faa6b6e4121bfcb6401074bb1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734dd5e7-8c30-441e-b76a-7ef236a20be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734dd5e7-8c30-441e-b76a-7ef236a20be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73726981-85c1-459c-8b5d-8b3799ef2f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73726981-85c1-459c-8b5d-8b3799ef2f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16abd0e4-28ac-4830-87d3-0555d2d0fe0c', 'volume_name': 'volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0acac55e-7b0e-4690-829e-b8ea4c51772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0acac55e-7b0e-4690-829e-b8ea4c51772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4546503-bba4-4167-97e0-fbdadf8fa4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:14 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Volume 16abd0e4-28ac-4830-87d3-0555d2d0fe0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c', 'volume_size': 1}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1596177686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16abd0e4-28ac-4830-87d3-0555d2d0fe0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31de9cb3b0c3426a87d29eef8dccd911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:14Z,use_quota=True,user_id='8f810faa6b6e4121bfcb6401074bb1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Creating volume 16abd0e4-28ac-4830-87d3-0555d2d0fe0c {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:50:14 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:14 devstack sudo[102155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c 1073741824
Sep 16 08:50:14 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:14 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-3932f2a2-f195-4344-ac77-4681e512ba16 tempest-TestShelveInstance-569985484 None] Terminate volume connection completed successfully.
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-3932f2a2-f195-4344-ac77-4681e512ba16 tempest-TestShelveInstance-569985484 None] Deleting attachment 23fe338a-44af-4800-8d61-c1d4a0503940. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:50:14 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c 1073741824" returned: 0 in 0.517s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Acquiring lock "cinder-72c15499-e891-4d3e-a00b-4f3eb3628a3c-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:14 devstack sudo[102163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c
Sep 16 08:50:14 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Lock "cinder-72c15499-e891-4d3e-a00b-4f3eb3628a3c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Acquiring lock "cinder-quobyte-72c15499-e891-4d3e-a00b-4f3eb3628a3c" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Lock "cinder-quobyte-72c15499-e891-4d3e-a00b-4f3eb3628a3c" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[23623ea7-3e98-489b-ad2c-21fc2bd4f825]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:14 devstack sudo[102165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c
Sep 16 08:50:14 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:15 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c" returned: 0 in 0.318s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4546503-bba4-4167-97e0-fbdadf8fa4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45194ad0-50cd-4b30-a5d4-f41fc24019c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:15 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Volume volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c (16abd0e4-28ac-4830-87d3-0555d2d0fe0c): created successfully
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45194ad0-50cd-4b30-a5d4-f41fc24019c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Flow 'volume_create_manager' (40a9c663-6b82-491f-8562-7a7f4b377665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:15 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-261ea7c3-789e-4c14-adc2-4fbd57e06f52 tempest-VolumesSnapshotTestJSON-1227289177 None] Created volume successfully.
Sep 16 08:50:15 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c" returned: 0 in 0.456s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:15 devstack sudo[102171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c
Sep 16 08:50:15 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:15 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-72c15499-e891-4d3e-a00b-4f3eb3628a3c" returned: 0 in 0.248s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Lock "cinder-quobyte-72c15499-e891-4d3e-a00b-4f3eb3628a3c" released by "delete_volume" :: held 0.753s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG cinder.quota [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Created reservations ['b53ecc65-97f7-4509-8561-57c7b8d3be95', '8600879e-e8d3-4cd0-b35c-ce4e057a4f0e', '86d4dac7-99ed-46da-b7cb-6faaff4d7e68', '5dcde88a-1a86-4354-a5f6-15248d4f6119'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:15 devstack sudo[102174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:15 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:15 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.247s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG cinder.manager [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:15 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Deleted volume successfully.
Sep 16 08:50:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [req-b6f86156-1aab-41e3-b403-f0f3af1a340b req-e2ee306c-3e24-4dd7-8a8f-978a349fdd57 tempest-TestShelveInstance-569985484 None] Lock "cinder-72c15499-e891-4d3e-a00b-4f3eb3628a3c-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] Creating offline snapshot 8bed3622-a5a0-4bd6-85ae-3ba073f57199 of volume 16abd0e4-28ac-4830-87d3-0555d2d0fe0c {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:50:16 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[99675179-cc66-4555-b54c-5c8155cb709f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:16 devstack sudo[102177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c
Sep 16 08:50:16 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:16 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c" returned: 0 in 0.376s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:16 devstack sudo[102182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199 1G
Sep 16 08:50:16 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:17 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199 1G" returned: 0 in 0.449s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:17 devstack sudo[102189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199
Sep 16 08:50:17 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:17 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199" returned: 0 in 0.345s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:17 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199 is being set with open permissions: ugo+rw
Sep 16 08:50:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:17 devstack sudo[102194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199
Sep 16 08:50:17 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:17 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199" returned: 0 in 0.247s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:17 devstack sudo[102197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.info
Sep 16 08:50:17 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:18 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.info" returned: 0 in 0.300s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:18 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.info is being set with open permissions: ugo+rw
Sep 16 08:50:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:18 devstack sudo[102201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.info
Sep 16 08:50:18 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:18 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.info" returned: 0 in 0.250s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.068s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:18 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bba0f10b-1e5f-4d69-8c02-d18528ed749a tempest-VolumesSnapshotTestJSON-1227289177 None] Create snapshot completed successfully
Sep 16 08:50:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-8bed3622-a5a0-4bd6-85ae-3ba073f57199-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-8bed3622-a5a0-4bd6-85ae-3ba073f57199-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-16abd0e4-28ac-4830-87d3-0555d2d0fe0c" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-16abd0e4-28ac-4830-87d3-0555d2d0fe0c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-8bed3622-a5a0-4bd6-85ae-3ba073f57199" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-8bed3622-a5a0-4bd6-85ae-3ba073f57199" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Deleting offline snapshot 8bed3622-a5a0-4bd6-85ae-3ba073f57199 of volume 16abd0e4-28ac-4830-87d3-0555d2d0fe0c {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:50:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] snapshot_file for this snap is: volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:50:19 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b9ec45-6d89-4056-bab7-4f0a92e41ea4]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:19 devstack sudo[102204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199
Sep 16 08:50:19 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:20 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199" returned: 0 in 0.418s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:50:20 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fa9634-bd9f-4825-a723-43862ee44bcc]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:20 devstack sudo[102209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c
Sep 16 08:50:20 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:20 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c" returned: 0 in 0.413s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:20 devstack sudo[102214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199
Sep 16 08:50:20 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:21 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199" returned: 0 in 0.393s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:21 devstack sudo[102220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199
Sep 16 08:50:21 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:21 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c.8bed3622-a5a0-4bd6-85ae-3ba073f57199" returned: 0 in 0.254s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-8bed3622-a5a0-4bd6-85ae-3ba073f57199" released by "_delete_snapshot" :: held 1.603s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-16abd0e4-28ac-4830-87d3-0555d2d0fe0c" released by "delete_snapshot" :: held 1.628s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:21 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Created reservations ['29c64053-9878-451f-9ecd-071fbd8af240', 'ebdf283e-6152-4de8-9a4c-d850b09d69c7', '22ab7e51-c00e-4dfe-9945-f0539de6227e', '1a466d8d-9e06-473f-9977-a183d9c6af44'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:21 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Delete snapshot completed successfully.
Sep 16 08:50:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97e5dc1c-a576-4e36-b8eb-34f62938967a tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-8bed3622-a5a0-4bd6-85ae-3ba073f57199-delete_snapshot" released by "delete_snapshot" :: held 1.803s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Flow 'volume_create_manager' (e6ad31ef-3a5a-45ae-abee-512d57d41597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ae3a8d-72e1-4811-a653-fe77279f24a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ae3a8d-72e1-4811-a653-fe77279f24a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-267999132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c768b2c9-682f-4a30-909c-97cf36e0d4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31de9cb3b0c3426a87d29eef8dccd911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:22Z,use_quota=True,user_id='8f810faa6b6e4121bfcb6401074bb1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bfc798-0b87-49eb-8aee-0dc357f5cd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bfc798-0b87-49eb-8aee-0dc357f5cd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6b2562-cb36-4a22-81bb-57a5a589a721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6b2562-cb36-4a22-81bb-57a5a589a721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c768b2c9-682f-4a30-909c-97cf36e0d4ba', 'volume_name': 'volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c4ea86-04f5-4523-8ee3-e762b1317081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c4ea86-04f5-4523-8ee3-e762b1317081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd53f18-0936-4a1a-9a17-78a314d6640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:22 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Volume c768b2c9-682f-4a30-909c-97cf36e0d4ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba', 'volume_size': 1}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-267999132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c768b2c9-682f-4a30-909c-97cf36e0d4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31de9cb3b0c3426a87d29eef8dccd911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:22Z,use_quota=True,user_id='8f810faa6b6e4121bfcb6401074bb1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Creating volume c768b2c9-682f-4a30-909c-97cf36e0d4ba {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:50:22 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:50:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:22 devstack sudo[102225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba 1073741824
Sep 16 08:50:22 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:23 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba 1073741824" returned: 0 in 0.450s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:23 devstack sudo[102230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba
Sep 16 08:50:23 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:23 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba" returned: 0 in 0.251s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd53f18-0936-4a1a-9a17-78a314d6640c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5554cb-f712-4fb6-a669-192c124cdf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:23 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Volume volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba (c768b2c9-682f-4a30-909c-97cf36e0d4ba): created successfully
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5554cb-f712-4fb6-a669-192c124cdf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Flow 'volume_create_manager' (e6ad31ef-3a5a-45ae-abee-512d57d41597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:23 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e891114b-54ff-45cc-ad66-ff6952a57bfc tempest-VolumesSnapshotTestJSON-1227289177 None] Created volume successfully.
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] Creating offline snapshot 0f964ab7-f040-47d9-9f1f-75a8e1c4379e of volume c768b2c9-682f-4a30-909c-97cf36e0d4ba {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[532dabe8-9cb2-434a-9a38-e203c793e62b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:23 devstack sudo[102233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba
Sep 16 08:50:23 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:24 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba" returned: 0 in 0.369s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:24 devstack sudo[102238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e 1G
Sep 16 08:50:24 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:24 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e 1G" returned: 0 in 0.503s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:24 devstack sudo[102244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e
Sep 16 08:50:24 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:24 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e" returned: 0 in 0.309s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:24 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e is being set with open permissions: ugo+rw
Sep 16 08:50:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:24 devstack sudo[102249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e
Sep 16 08:50:24 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:25 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e" returned: 0 in 0.272s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:25 devstack sudo[102253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.info
Sep 16 08:50:25 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:25 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.info" returned: 0 in 0.280s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:25 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.info is being set with open permissions: ugo+rw
Sep 16 08:50:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:25 devstack sudo[102256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.info
Sep 16 08:50:25 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:25 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.info" returned: 0 in 0.275s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:25 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0df4fb7f-e479-43f4-ac71-e4694689541b tempest-VolumesSnapshotTestJSON-1227289177 None] Create snapshot completed successfully
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Flow 'volume_create_manager' (410fc15f-20ff-4dad-bf56-7b1e2ee797ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039e2af5-3ea3-469f-b924-0274b854567c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039e2af5-3ea3-469f-b924-0274b854567c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-634548416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663cfc81-3e1c-4833-863a-629f45f5819c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31de9cb3b0c3426a87d29eef8dccd911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0f964ab7-f040-47d9-9f1f-75a8e1c4379e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:27Z,use_quota=True,user_id='8f810faa6b6e4121bfcb6401074bb1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b57e16b-1758-4cbd-bdb4-44611f4ebdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b57e16b-1758-4cbd-bdb4-44611f4ebdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c89c05-2b11-4576-867a-6998e8902930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c89c05-2b11-4576-867a-6998e8902930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '663cfc81-3e1c-4833-863a-629f45f5819c', 'volume_name': 'volume-663cfc81-3e1c-4833-863a-629f45f5819c', 'volume_size': 2, 'snapshot_id': '0f964ab7-f040-47d9-9f1f-75a8e1c4379e'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f246934d-a07b-43d2-88ee-ab1c7ecb99f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f246934d-a07b-43d2-88ee-ab1c7ecb99f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1635dafa-d982-4abf-a57c-b5247a5dcfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:27 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Volume 663cfc81-3e1c-4833-863a-629f45f5819c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-663cfc81-3e1c-4833-863a-629f45f5819c', 'volume_size': 2, 'snapshot_id': '0f964ab7-f040-47d9-9f1f-75a8e1c4379e'}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-0f964ab7-f040-47d9-9f1f-75a8e1c4379e-663cfc81-3e1c-4833-863a-629f45f5819c" by "_create_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-0f964ab7-f040-47d9-9f1f-75a8e1c4379e-663cfc81-3e1c-4833-863a-629f45f5819c" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Creating volume 663cfc81-3e1c-4833-863a-629f45f5819c from snapshot 0f964ab7-f040-47d9-9f1f-75a8e1c4379e {{(pid=86261) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-663cfc81-3e1c-4833-863a-629f45f5819c" by "_copy_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-663cfc81-3e1c-4833-863a-629f45f5819c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] snapshot: 0f964ab7-f040-47d9-9f1f-75a8e1c4379e, volume: 663cfc81-3e1c-4833-863a-629f45f5819c,  {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[322701be-6193-4b8f-a9e7-cdf0ba785986]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:27 devstack sudo[102259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e
Sep 16 08:50:27 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:27 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e" returned: 0 in 0.371s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb9e451-1430-46d0-bde2-912fd11555c4]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:28 devstack sudo[102264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba
Sep 16 08:50:28 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:28 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba" returned: 0 in 0.387s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Creating direct copy from snapshot {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.utils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Path /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c not found in is_blk_device check {{(pid=86261) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:28 devstack sudo[102269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c
Sep 16 08:50:28 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Flow 'volume_create_manager' (3058ccd5-83e7-4e94-9d1e-96aacf11c8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136d200f-8003-4db5-bfb8-c388cc266172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136d200f-8003-4db5-bfb8-c388cc266172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1474772076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35389cab-1595-4dbb-aa6c-7a06dea4c2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f586ae0b2fda4231b74740ffb0c68dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:29Z,use_quota=True,user_id='1da9b49bad9d437ab446fc86018e0603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286f066d-5a81-4bae-b634-899781c2f083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286f066d-5a81-4bae-b634-899781c2f083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8b040b-c432-4fcd-b390-674fbe59915c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8b040b-c432-4fcd-b390-674fbe59915c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35389cab-1595-4dbb-aa6c-7a06dea4c2d5', 'volume_name': 'volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6edbdeb-cf88-48ce-b8c1-816f2ec4e165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6edbdeb-cf88-48ce-b8c1-816f2ec4e165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c47f4f-8808-49d5-b072-d65d408da6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:28 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Volume 35389cab-1595-4dbb-aa6c-7a06dea4c2d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5', 'volume_size': 1}
Sep 16 08:50:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:29 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:50:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Flow 'volume_create_manager' (2b300d52-abba-4195-b9ba-d2ae6802a852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b21192b-bea7-442c-bbac-df16d56f3e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b21192b-bea7-442c-bbac-df16d56f3e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1780154447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60ed5b0-096d-45a3-8faf-82e7ef4f90a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f586ae0b2fda4231b74740ffb0c68dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:29Z,use_quota=True,user_id='1da9b49bad9d437ab446fc86018e0603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff2b24e-699d-40b2-a820-855c89220a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff2b24e-699d-40b2-a820-855c89220a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2982e3f7-100d-4319-943d-2f2a35d574c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2982e3f7-100d-4319-943d-2f2a35d574c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c60ed5b0-096d-45a3-8faf-82e7ef4f90a1', 'volume_name': 'volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e08ab0-8346-425c-9500-0a956636ae10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e08ab0-8346-425c-9500-0a956636ae10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56680ef1-bfc3-42e0-9690-cfb880b3d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:29 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Volume c60ed5b0-096d-45a3-8faf-82e7ef4f90a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1', 'volume_size': 1}
Sep 16 08:50:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Flow 'volume_create_manager' (aba431de-dac2-4994-b299-04995010deb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9401a4c-bb9e-49f7-8d9e-fa2b7092e5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9401a4c-bb9e-49f7-8d9e-fa2b7092e5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501140217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea373b27-477c-4d12-9754-367bfa79c957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f586ae0b2fda4231b74740ffb0c68dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:30Z,use_quota=True,user_id='1da9b49bad9d437ab446fc86018e0603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7ba44b-ba2d-4e14-be31-2ac194c41346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7ba44b-ba2d-4e14-be31-2ac194c41346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c326c16-ddeb-41d7-9845-916e2f076e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c326c16-ddeb-41d7-9845-916e2f076e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea373b27-477c-4d12-9754-367bfa79c957', 'volume_name': 'volume-ea373b27-477c-4d12-9754-367bfa79c957', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15865ae0-bb49-48e9-b014-28fc042519d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15865ae0-bb49-48e9-b014-28fc042519d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baee6da8-ea77-4eab-8f18-b7b485b12634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:30 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Volume ea373b27-477c-4d12-9754-367bfa79c957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea373b27-477c-4d12-9754-367bfa79c957', 'volume_size': 1}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Flow 'volume_create_manager' (18719751-5b3f-4576-b220-639fca5c466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141f71ee-68bf-49e2-88de-0001c62d6b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141f71ee-68bf-49e2-88de-0001c62d6b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2003361012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01db7286-75d5-46c7-9971-6de50a97f613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f586ae0b2fda4231b74740ffb0c68dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:30Z,use_quota=True,user_id='1da9b49bad9d437ab446fc86018e0603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3d0b8a-a4d7-4daa-8da6-96df155828ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3d0b8a-a4d7-4daa-8da6-96df155828ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fccd846-4422-433c-83a8-495081dbdfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fccd846-4422-433c-83a8-495081dbdfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01db7286-75d5-46c7-9971-6de50a97f613', 'volume_name': 'volume-01db7286-75d5-46c7-9971-6de50a97f613', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6407358b-fc70-4329-a22d-bb71c9e240c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6407358b-fc70-4329-a22d-bb71c9e240c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e45096-1b28-4aa6-9b5b-2fd68bd8ef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:30 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Volume 01db7286-75d5-46c7-9971-6de50a97f613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01db7286-75d5-46c7-9971-6de50a97f613', 'volume_size': 1}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Flow 'volume_create_manager' (e006bd4d-377b-4b81-8c16-35aed62d18c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf892a8-c1d7-4a98-a61c-52471705be84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf892a8-c1d7-4a98-a61c-52471705be84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-905047578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e816ec-fc57-43dc-90a3-76caefe71f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f586ae0b2fda4231b74740ffb0c68dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:31Z,use_quota=True,user_id='1da9b49bad9d437ab446fc86018e0603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfd51d1-4b1a-4562-b51e-b55a175e90b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfd51d1-4b1a-4562-b51e-b55a175e90b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d01efe-5eca-40a6-929b-25cc24478191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d01efe-5eca-40a6-929b-25cc24478191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e816ec-fc57-43dc-90a3-76caefe71f4f', 'volume_name': 'volume-23e816ec-fc57-43dc-90a3-76caefe71f4f', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9b1540-daae-4c70-b8be-495265f9bb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9b1540-daae-4c70-b8be-495265f9bb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b215eed9-d1b1-4f49-901e-028e0fa73096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:31 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Volume 23e816ec-fc57-43dc-90a3-76caefe71f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e816ec-fc57-43dc-90a3-76caefe71f4f', 'volume_size': 1}
Sep 16 08:50:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:35 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c" returned: 0 in 6.628s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:50:35 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Converted 1024.00 MB image at 154.47 MB/s
Sep 16 08:50:35 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c is being set with open permissions: ugo+rw
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:35 devstack sudo[102283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c
Sep 16 08:50:35 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:35 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c" returned: 0 in 0.244s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-663cfc81-3e1c-4833-863a-629f45f5819c" released by "_copy_volume_from_snapshot" :: held 7.718s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-0f964ab7-f040-47d9-9f1f-75a8e1c4379e-663cfc81-3e1c-4833-863a-629f45f5819c" released by "_create_volume_from_snapshot" :: held 7.794s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.822s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.435s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1474772076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35389cab-1595-4dbb-aa6c-7a06dea4c2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f586ae0b2fda4231b74740ffb0c68dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:29Z,use_quota=True,user_id='1da9b49bad9d437ab446fc86018e0603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Creating volume 35389cab-1595-4dbb-aa6c-7a06dea4c2d5 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:50:35 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:35 devstack sudo[102286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5 1073741824
Sep 16 08:50:35 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1635dafa-d982-4abf-a57c-b5247a5dcfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663cfc81-3e1c-4833-863a-629f45f5819c', 'volume_size': 2, 'snapshot_id': '0f964ab7-f040-47d9-9f1f-75a8e1c4379e'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898b6e00-ff6a-48cd-b1cf-abda5e536244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:35 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Volume volume-663cfc81-3e1c-4833-863a-629f45f5819c (663cfc81-3e1c-4833-863a-629f45f5819c): created successfully
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898b6e00-ff6a-48cd-b1cf-abda5e536244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Flow 'volume_create_manager' (410fc15f-20ff-4dad-bf56-7b1e2ee797ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:35 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-392a207f-4f14-48df-9288-35545e089652 tempest-VolumesSnapshotTestJSON-1227289177 None] Created volume successfully.
Sep 16 08:50:35 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5 1073741824" returned: 0 in 0.396s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:35 devstack sudo[102292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5
Sep 16 08:50:35 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:35 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5" returned: 0 in 0.232s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.527s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1780154447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60ed5b0-096d-45a3-8faf-82e7ef4f90a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f586ae0b2fda4231b74740ffb0c68dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:29Z,use_quota=True,user_id='1da9b49bad9d437ab446fc86018e0603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Creating volume c60ed5b0-096d-45a3-8faf-82e7ef4f90a1 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:50:35 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:50:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c47f4f-8808-49d5-b072-d65d408da6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:36 devstack sudo[102295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1 1073741824
Sep 16 08:50:36 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfd4cae-d366-40e7-aa62-951a6e6195a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:36 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Volume volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5 (35389cab-1595-4dbb-aa6c-7a06dea4c2d5): created successfully
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfd4cae-d366-40e7-aa62-951a6e6195a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Flow 'volume_create_manager' (3058ccd5-83e7-4e94-9d1e-96aacf11c8ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:36 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9d257b3e-e90d-4374-b667-102e43ef6bc5 tempest-CreateVolumesFromImageTest-978976682 None] Created volume successfully.
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-663cfc81-3e1c-4833-863a-629f45f5819c-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-663cfc81-3e1c-4833-863a-629f45f5819c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-663cfc81-3e1c-4833-863a-629f45f5819c" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-663cfc81-3e1c-4833-863a-629f45f5819c" acquired by "delete_volume" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe1a13-8165-4414-8fee-bbfc01807262]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:36 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1 1073741824" returned: 0 in 0.465s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:36 devstack sudo[102302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1
Sep 16 08:50:36 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:36 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c
Sep 16 08:50:36 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:36 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1" returned: 0 in 0.242s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.462s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501140217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea373b27-477c-4d12-9754-367bfa79c957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f586ae0b2fda4231b74740ffb0c68dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:30Z,use_quota=True,user_id='1da9b49bad9d437ab446fc86018e0603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Creating volume ea373b27-477c-4d12-9754-367bfa79c957 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:50:36 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea373b27-477c-4d12-9754-367bfa79c957 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:36 devstack sudo[102309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea373b27-477c-4d12-9754-367bfa79c957 1073741824
Sep 16 08:50:36 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56680ef1-bfc3-42e0-9690-cfb880b3d898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5989abd-815b-4533-97ff-95399f6a6ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:36 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Volume volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1 (c60ed5b0-096d-45a3-8faf-82e7ef4f90a1): created successfully
Sep 16 08:50:36 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5989abd-815b-4533-97ff-95399f6a6ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Flow 'volume_create_manager' (2b300d52-abba-4195-b9ba-d2ae6802a852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c" returned: 0 in 0.396s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:36 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f12186a1-7f00-45b2-ac85-cde5080b81f1 tempest-CreateVolumesFromImageTest-978976682 None] Created volume successfully.
Sep 16 08:50:36 devstack sudo[102311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c
Sep 16 08:50:36 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:37 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-663cfc81-3e1c-4833-863a-629f45f5819c" returned: 0 in 0.264s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-663cfc81-3e1c-4833-863a-629f45f5819c" released by "delete_volume" :: held 0.700s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Created reservations ['306543cd-1b0a-4e27-a766-fc0d73fee229', '9abfd060-f35f-44ce-b752-db1db007c1cb', '1b02a1cd-397f-467f-b8bf-7dafc86dade4', '2fdec489-fa82-4aa1-810f-9db36d96eb69'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:37 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea373b27-477c-4d12-9754-367bfa79c957 1073741824" returned: 0 in 0.455s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea373b27-477c-4d12-9754-367bfa79c957 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:37 devstack sudo[102318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:37 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:37 devstack sudo[102319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea373b27-477c-4d12-9754-367bfa79c957
Sep 16 08:50:37 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:37 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.295s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-0f964ab7-f040-47d9-9f1f-75a8e1c4379e-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Deleted volume successfully.
Sep 16 08:50:37 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-0f964ab7-f040-47d9-9f1f-75a8e1c4379e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-c768b2c9-682f-4a30-909c-97cf36e0d4ba" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea373b27-477c-4d12-9754-367bfa79c957" returned: 0 in 0.315s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.770s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2003361012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01db7286-75d5-46c7-9971-6de50a97f613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f586ae0b2fda4231b74740ffb0c68dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:30Z,use_quota=True,user_id='1da9b49bad9d437ab446fc86018e0603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Creating volume 01db7286-75d5-46c7-9971-6de50a97f613 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:50:37 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-01db7286-75d5-46c7-9971-6de50a97f613 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:37 devstack sudo[102324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-01db7286-75d5-46c7-9971-6de50a97f613 1073741824
Sep 16 08:50:37 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7323b566-ee24-4fac-b4a8-524973eaea65 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-663cfc81-3e1c-4833-863a-629f45f5819c-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-c768b2c9-682f-4a30-909c-97cf36e0d4ba" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-0f964ab7-f040-47d9-9f1f-75a8e1c4379e" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baee6da8-ea77-4eab-8f18-b7b485b12634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea373b27-477c-4d12-9754-367bfa79c957', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57b0af0-4e46-4eb2-9df3-51ffc2ffc07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-0f964ab7-f040-47d9-9f1f-75a8e1c4379e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Deleting offline snapshot 0f964ab7-f040-47d9-9f1f-75a8e1c4379e of volume c768b2c9-682f-4a30-909c-97cf36e0d4ba {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] snapshot_file for this snap is: volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:50:37 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Volume volume-ea373b27-477c-4d12-9754-367bfa79c957 (ea373b27-477c-4d12-9754-367bfa79c957): created successfully
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57b0af0-4e46-4eb2-9df3-51ffc2ffc07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Flow 'volume_create_manager' (aba431de-dac2-4994-b299-04995010deb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7151bd64-1100-472c-906a-1a9a5c7d3eaf]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-54d15099-e0e2-4c24-afc7-dccf31dc74b2 tempest-CreateVolumesFromImageTest-978976682 None] Created volume successfully.
Sep 16 08:50:37 devstack sudo[102326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e
Sep 16 08:50:37 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:38 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-01db7286-75d5-46c7-9971-6de50a97f613 1073741824" returned: 0 in 0.427s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-01db7286-75d5-46c7-9971-6de50a97f613 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:38 devstack sudo[102335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-01db7286-75d5-46c7-9971-6de50a97f613
Sep 16 08:50:38 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:38 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e" returned: 0 in 0.403s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0087db4f-5388-4881-94c8-018844e9b61b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:38 devstack sudo[102337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba
Sep 16 08:50:38 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:38 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-01db7286-75d5-46c7-9971-6de50a97f613" returned: 0 in 0.260s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.235s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-905047578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e816ec-fc57-43dc-90a3-76caefe71f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f586ae0b2fda4231b74740ffb0c68dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:31Z,use_quota=True,user_id='1da9b49bad9d437ab446fc86018e0603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Creating volume 23e816ec-fc57-43dc-90a3-76caefe71f4f {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:50:38 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-23e816ec-fc57-43dc-90a3-76caefe71f4f 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:38 devstack sudo[102340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-23e816ec-fc57-43dc-90a3-76caefe71f4f 1073741824
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e45096-1b28-4aa6-9b5b-2fd68bd8ef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01db7286-75d5-46c7-9971-6de50a97f613', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:38 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60513be-9f4a-4224-b375-d2f1dedc0697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:38 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Volume volume-01db7286-75d5-46c7-9971-6de50a97f613 (01db7286-75d5-46c7-9971-6de50a97f613): created successfully
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60513be-9f4a-4224-b375-d2f1dedc0697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Flow 'volume_create_manager' (18719751-5b3f-4576-b220-639fca5c466e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1573e74a-5b37-498a-a3c1-8e9e6d786206 tempest-CreateVolumesFromImageTest-978976682 None] Created volume successfully.
Sep 16 08:50:38 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba" returned: 0 in 0.582s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:38 devstack sudo[102349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e
Sep 16 08:50:38 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:38 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-23e816ec-fc57-43dc-90a3-76caefe71f4f 1073741824" returned: 0 in 0.466s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-23e816ec-fc57-43dc-90a3-76caefe71f4f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:38 devstack sudo[102351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-23e816ec-fc57-43dc-90a3-76caefe71f4f
Sep 16 08:50:38 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:39 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e" returned: 0 in 0.324s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:39 devstack sudo[102357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e
Sep 16 08:50:39 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:39 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-23e816ec-fc57-43dc-90a3-76caefe71f4f" returned: 0 in 0.263s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b215eed9-d1b1-4f49-901e-028e0fa73096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e816ec-fc57-43dc-90a3-76caefe71f4f', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b9b92d-d1ca-49c8-a767-27be5ec2926c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:39 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Volume volume-23e816ec-fc57-43dc-90a3-76caefe71f4f (23e816ec-fc57-43dc-90a3-76caefe71f4f): created successfully
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b9b92d-d1ca-49c8-a767-27be5ec2926c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Flow 'volume_create_manager' (e006bd4d-377b-4b81-8c16-35aed62d18c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:39 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-62eb4cef-1348-4d1e-9c11-f6e97d57ca07 tempest-CreateVolumesFromImageTest-978976682 None] Created volume successfully.
Sep 16 08:50:39 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba.0f964ab7-f040-47d9-9f1f-75a8e1c4379e" returned: 0 in 0.252s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-0f964ab7-f040-47d9-9f1f-75a8e1c4379e" released by "_delete_snapshot" :: held 1.676s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-c768b2c9-682f-4a30-909c-97cf36e0d4ba" released by "delete_snapshot" :: held 1.714s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Created reservations ['d7d89b80-896b-41ad-ada5-6e4016c50991', '43bb8b01-2d66-418a-a12d-c75be1bf60b0', '3f03082a-1ffb-4903-a7a8-2bcf4dfe51ae', '42f92faf-936b-4bd5-8142-61338a41e49f'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:39 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Delete snapshot completed successfully.
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0d68c451-c30d-414d-9b83-9e7ad33db452 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-0f964ab7-f040-47d9-9f1f-75a8e1c4379e-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "cinder-23e816ec-fc57-43dc-90a3-76caefe71f4f-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-23e816ec-fc57-43dc-90a3-76caefe71f4f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "cinder-quobyte-23e816ec-fc57-43dc-90a3-76caefe71f4f" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-quobyte-23e816ec-fc57-43dc-90a3-76caefe71f4f" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[78de548b-2b75-4fa6-9f27-c8c3eea7d867]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-23e816ec-fc57-43dc-90a3-76caefe71f4f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-c768b2c9-682f-4a30-909c-97cf36e0d4ba-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-c768b2c9-682f-4a30-909c-97cf36e0d4ba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-c768b2c9-682f-4a30-909c-97cf36e0d4ba" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-c768b2c9-682f-4a30-909c-97cf36e0d4ba" acquired by "delete_volume" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:39 devstack sudo[102362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-23e816ec-fc57-43dc-90a3-76caefe71f4f
Sep 16 08:50:39 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f526bc17-cc02-4927-8c91-c2cc0823a9b4]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:40 devstack sudo[102364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba
Sep 16 08:50:40 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:40 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-23e816ec-fc57-43dc-90a3-76caefe71f4f" returned: 0 in 0.382s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-23e816ec-fc57-43dc-90a3-76caefe71f4f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:40 devstack sudo[102369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-23e816ec-fc57-43dc-90a3-76caefe71f4f
Sep 16 08:50:40 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:40 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba" returned: 0 in 0.386s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:40 devstack sudo[102374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba
Sep 16 08:50:40 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:40 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-23e816ec-fc57-43dc-90a3-76caefe71f4f" returned: 0 in 0.273s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-quobyte-23e816ec-fc57-43dc-90a3-76caefe71f4f" released by "delete_volume" :: held 0.701s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Created reservations ['b639ab80-1867-4d54-85ed-471c577b3a5c', 'da5cfdc5-0eae-475b-9ee7-e805b8087be8', '4760a3d0-0a43-41f4-834c-61028426faee', '4e644dc4-ce2f-49c7-9d16-66ad0a131227'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:40 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c768b2c9-682f-4a30-909c-97cf36e0d4ba" returned: 0 in 0.273s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:40 devstack sudo[102378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:40 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-c768b2c9-682f-4a30-909c-97cf36e0d4ba" released by "delete_volume" :: held 0.731s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Created reservations ['a795d242-e6b2-4f61-9e8e-2b5471d61565', '10377dbd-7384-44fb-83e5-5c2e0823e71f', '27829538-5de1-4534-b0d8-512e447364fb', '0ace5cf1-e571-4b84-aad4-cd79297fb1f7'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:40 devstack sudo[102380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:40 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:40 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.255s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:40 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Deleted volume successfully.
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "cinder-01db7286-75d5-46c7-9971-6de50a97f613-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ce22c184-8489-41f5-97c7-e891e1cbede1 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-23e816ec-fc57-43dc-90a3-76caefe71f4f-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-01db7286-75d5-46c7-9971-6de50a97f613-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "cinder-quobyte-01db7286-75d5-46c7-9971-6de50a97f613" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-quobyte-01db7286-75d5-46c7-9971-6de50a97f613" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[07812104-51ea-4fb4-82e2-780f6c305ff9]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-01db7286-75d5-46c7-9971-6de50a97f613 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:40 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.265s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:40 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:40 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Deleted volume successfully.
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-baa11d35-e6cd-4053-a005-048b1d35f7e6 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-c768b2c9-682f-4a30-909c-97cf36e0d4ba-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:41 devstack sudo[102384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-01db7286-75d5-46c7-9971-6de50a97f613
Sep 16 08:50:41 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:41 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-01db7286-75d5-46c7-9971-6de50a97f613" returned: 0 in 0.401s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-01db7286-75d5-46c7-9971-6de50a97f613 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:41 devstack sudo[102389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-01db7286-75d5-46c7-9971-6de50a97f613
Sep 16 08:50:41 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Flow 'volume_create_manager' (de12ac75-fd27-4de3-8c1b-c491d5ea1177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef98186-635e-492d-bc7a-c0ea9a8c4959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef98186-635e-492d-bc7a-c0ea9a8c4959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2066775440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a947cba9-108e-4746-9e16-0ee0370d43be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31de9cb3b0c3426a87d29eef8dccd911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:41Z,use_quota=True,user_id='8f810faa6b6e4121bfcb6401074bb1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e936da-4436-4aac-84cd-79143c0b2180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e936da-4436-4aac-84cd-79143c0b2180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d293ee16-366b-4546-bd6e-07dc784822fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d293ee16-366b-4546-bd6e-07dc784822fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a947cba9-108e-4746-9e16-0ee0370d43be', 'volume_name': 'volume-a947cba9-108e-4746-9e16-0ee0370d43be', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba76dae-5860-4c77-a1ee-25e6e3f380c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba76dae-5860-4c77-a1ee-25e6e3f380c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80408029-a70b-4ba9-8f53-6ae6b6989ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:41 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Volume a947cba9-108e-4746-9e16-0ee0370d43be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a947cba9-108e-4746-9e16-0ee0370d43be', 'volume_size': 1}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2066775440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a947cba9-108e-4746-9e16-0ee0370d43be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31de9cb3b0c3426a87d29eef8dccd911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:41Z,use_quota=True,user_id='8f810faa6b6e4121bfcb6401074bb1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Creating volume a947cba9-108e-4746-9e16-0ee0370d43be {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:50:41 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:41 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-01db7286-75d5-46c7-9971-6de50a97f613" returned: 0 in 0.260s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:41 devstack sudo[102393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be 1073741824
Sep 16 08:50:41 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-quobyte-01db7286-75d5-46c7-9971-6de50a97f613" released by "delete_volume" :: held 0.710s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Created reservations ['107b04d5-9f0f-4d88-ab35-725260c2cde5', 'c2553483-2141-4b58-abfa-d2c522d5f784', '18a64190-a58b-4959-936e-b0a73b033740', 'e839ed18-1468-4cd7-bcf8-09863cadd7da'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:41 devstack sudo[102395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:41 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:42 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "cinder-ea373b27-477c-4d12-9754-367bfa79c957-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.295s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:42 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:42 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Deleted volume successfully.
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be 1073741824" returned: 0 in 0.462s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-ea373b27-477c-4d12-9754-367bfa79c957-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5e57460d-5a74-4a97-a670-72e3697bb0e4 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-01db7286-75d5-46c7-9971-6de50a97f613-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "cinder-quobyte-ea373b27-477c-4d12-9754-367bfa79c957" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:42 devstack sudo[102401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be
Sep 16 08:50:42 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-quobyte-ea373b27-477c-4d12-9754-367bfa79c957" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f7d0ba-8756-4a67-a7e2-11b7c0315600]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea373b27-477c-4d12-9754-367bfa79c957 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:42 devstack sudo[102403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea373b27-477c-4d12-9754-367bfa79c957
Sep 16 08:50:42 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:42 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be" returned: 0 in 0.259s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80408029-a70b-4ba9-8f53-6ae6b6989ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a947cba9-108e-4746-9e16-0ee0370d43be', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f039ccd-8295-4731-a132-653a94d7cd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:42 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Volume volume-a947cba9-108e-4746-9e16-0ee0370d43be (a947cba9-108e-4746-9e16-0ee0370d43be): created successfully
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f039ccd-8295-4731-a132-653a94d7cd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Flow 'volume_create_manager' (de12ac75-fd27-4de3-8c1b-c491d5ea1177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:42 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-45b0155c-2c26-4048-887b-7df9aa2444f2 tempest-VolumesSnapshotTestJSON-1227289177 None] Created volume successfully.
Sep 16 08:50:42 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea373b27-477c-4d12-9754-367bfa79c957" returned: 0 in 0.386s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea373b27-477c-4d12-9754-367bfa79c957 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:42 devstack sudo[102409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea373b27-477c-4d12-9754-367bfa79c957
Sep 16 08:50:42 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] Creating offline snapshot aff2a9bf-66d2-4d65-b4fe-e231750c6901 of volume a947cba9-108e-4746-9e16-0ee0370d43be {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4adf5a3-8818-40cc-8a43-0ae80b15fab9]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:42 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea373b27-477c-4d12-9754-367bfa79c957" returned: 0 in 0.279s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-quobyte-ea373b27-477c-4d12-9754-367bfa79c957" released by "delete_volume" :: held 0.707s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:42 devstack sudo[102411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be
Sep 16 08:50:42 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Created reservations ['0381bd14-817a-426e-82f7-5f8bb9567c0c', 'fd15611d-5b23-4bcb-854b-dc02faab5034', 'be413963-04b1-4586-91fa-cbf85a2d71bd', '65fd2fd5-376d-4bbe-ac8f-d6528836c5b5'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:42 devstack sudo[102414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:42 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:43 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be" returned: 0 in 0.367s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:43 devstack sudo[102419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901 1G
Sep 16 08:50:43 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "cinder-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:43 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.264s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:43 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Deleted volume successfully.
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-146097d7-e039-44e2-9205-2626c7bb817a tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-ea373b27-477c-4d12-9754-367bfa79c957-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "cinder-quobyte-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-quobyte-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1" acquired by "delete_volume" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ec6035-2c67-46c3-8e17-2f728d678855]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:43 devstack sudo[102422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1
Sep 16 08:50:43 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:43 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901 1G" returned: 0 in 0.441s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a947cba9-108e-4746-9e16-0ee0370d43be -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:43 devstack sudo[102428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a947cba9-108e-4746-9e16-0ee0370d43be -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901
Sep 16 08:50:43 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:43 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1" returned: 0 in 0.402s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:43 devstack sudo[102433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1
Sep 16 08:50:43 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:43 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a947cba9-108e-4746-9e16-0ee0370d43be -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901" returned: 0 in 0.297s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:43 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901 is being set with open permissions: ugo+rw
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:43 devstack sudo[102438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901
Sep 16 08:50:43 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:43 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1" returned: 0 in 0.256s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-quobyte-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1" released by "delete_volume" :: held 0.703s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Created reservations ['353570d6-d354-42d1-9550-a5f2244dcb3b', '85053321-b5e6-473e-976b-f4dc3edb4e46', '1843bd88-ed3b-4016-b102-f27e8d4697db', 'bc72ee65-ca13-453c-819c-a902f210c26c'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:44 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901" returned: 0 in 0.255s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:44 devstack sudo[102442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:44 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:44 devstack sudo[102444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.info
Sep 16 08:50:44 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "cinder-35389cab-1595-4dbb-aa6c-7a06dea4c2d5-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:44 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.269s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:44 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Deleted volume successfully.
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-35389cab-1595-4dbb-aa6c-7a06dea4c2d5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6b268bcd-7302-469a-aff8-a9c1ddfdea64 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-c60ed5b0-096d-45a3-8faf-82e7ef4f90a1-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:44 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.info" returned: 0 in 0.282s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:44 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.info is being set with open permissions: ugo+rw
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "cinder-quobyte-35389cab-1595-4dbb-aa6c-7a06dea4c2d5" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:44 devstack sudo[102448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.info
Sep 16 08:50:44 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-quobyte-35389cab-1595-4dbb-aa6c-7a06dea4c2d5" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dccf7c-34e8-44c5-9241-4511d5371a05]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:44 devstack sudo[102450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5
Sep 16 08:50:44 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:44 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.info" returned: 0 in 0.263s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:44 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-335b8290-b3ad-4a8a-afe7-f1fcc39cc13d tempest-VolumesSnapshotTestJSON-1227289177 None] Create snapshot completed successfully
Sep 16 08:50:44 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5" returned: 0 in 0.376s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:44 devstack sudo[102456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5
Sep 16 08:50:44 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:45 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-35389cab-1595-4dbb-aa6c-7a06dea4c2d5" returned: 0 in 0.261s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-quobyte-35389cab-1595-4dbb-aa6c-7a06dea4c2d5" released by "delete_volume" :: held 0.684s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:45 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Created reservations ['ea37ef7b-d15a-403a-8543-d22568df2a62', '5d5bc02a-1592-4e73-a04d-17c7fe8ad497', '733eb91a-618c-46fe-8e53-9e04e6d2be9f', '2c48a7e4-17fd-45fb-8e8d-fbf88d1829e7'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:45 devstack sudo[102495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:45 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:45 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.259s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:45 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:45 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Deleted volume successfully.
Sep 16 08:50:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8904edbf-d61d-4339-bbca-0ae20aed8ae9 tempest-CreateVolumesFromImageTest-978976682 None] Lock "cinder-35389cab-1595-4dbb-aa6c-7a06dea4c2d5-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Flow 'volume_create_manager' (3a7a825a-7471-4fe3-b2e5-d8b43c19c823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d61b955-0bd9-425b-b72f-5a8b73133503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d61b955-0bd9-425b-b72f-5a8b73133503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1829706252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03edf0f4-f9c6-46cd-93c5-95f889a6bf41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31de9cb3b0c3426a87d29eef8dccd911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aff2a9bf-66d2-4d65-b4fe-e231750c6901,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:50:46Z,use_quota=True,user_id='8f810faa6b6e4121bfcb6401074bb1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc147d13-3b50-45d6-a23b-18d2552608b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc147d13-3b50-45d6-a23b-18d2552608b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb9c2e8-cfcb-407a-b7a8-8061e2a86a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb9c2e8-cfcb-407a-b7a8-8061e2a86a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '03edf0f4-f9c6-46cd-93c5-95f889a6bf41', 'volume_name': 'volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41', 'volume_size': 1, 'snapshot_id': 'aff2a9bf-66d2-4d65-b4fe-e231750c6901'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8511c65-cf52-41fb-a87c-84374d209c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8511c65-cf52-41fb-a87c-84374d209c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a254fb05-f10e-4510-abd1-f962a35dc187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:46 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Volume 03edf0f4-f9c6-46cd-93c5-95f889a6bf41: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41', 'volume_size': 1, 'snapshot_id': 'aff2a9bf-66d2-4d65-b4fe-e231750c6901'}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-aff2a9bf-66d2-4d65-b4fe-e231750c6901-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" by "_create_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-aff2a9bf-66d2-4d65-b4fe-e231750c6901-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Creating volume 03edf0f4-f9c6-46cd-93c5-95f889a6bf41 from snapshot aff2a9bf-66d2-4d65-b4fe-e231750c6901 {{(pid=86261) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" by "_copy_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] snapshot: aff2a9bf-66d2-4d65-b4fe-e231750c6901, volume: 03edf0f4-f9c6-46cd-93c5-95f889a6bf41,  {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e625df74-031e-4830-87da-5f836508e77e]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:46 devstack sudo[102498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901
Sep 16 08:50:46 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:46 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901" returned: 0 in 0.391s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a947cba9-108e-4746-9e16-0ee0370d43be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf7c5f4-6504-4e64-9e45-190b87efa005]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:47 devstack sudo[102503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be
Sep 16 08:50:47 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:47 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be" returned: 0 in 0.361s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 08:50:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Creating direct copy from snapshot {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 08:50:47 devstack cinder-volume[86261]: DEBUG cinder.utils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Path /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41 not found in is_blk_device check {{(pid=86261) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 08:50:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:47 devstack sudo[102508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41
Sep 16 08:50:47 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:53 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" returned: 0 in 6.096s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:50:53 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Converted 1024.00 MB image at 167.95 MB/s
Sep 16 08:50:53 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41 is being set with open permissions: ugo+rw
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:53 devstack sudo[102524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41
Sep 16 08:50:53 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:53 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" returned: 0 in 0.246s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" released by "_copy_volume_from_snapshot" :: held 7.177s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-aff2a9bf-66d2-4d65-b4fe-e231750c6901-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" released by "_create_volume_from_snapshot" :: held 7.236s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.253s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a254fb05-f10e-4510-abd1-f962a35dc187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41', 'volume_size': 1, 'snapshot_id': 'aff2a9bf-66d2-4d65-b4fe-e231750c6901'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca7502c-11db-485c-b7c8-977bdf20f20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:50:53 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Volume volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41 (03edf0f4-f9c6-46cd-93c5-95f889a6bf41): created successfully
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca7502c-11db-485c-b7c8-977bdf20f20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Flow 'volume_create_manager' (3a7a825a-7471-4fe3-b2e5-d8b43c19c823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:50:53 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-66878254-610f-4bf4-b1ec-8c36a614f199 tempest-VolumesSnapshotTestJSON-1227289177 None] Created volume successfully.
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-03edf0f4-f9c6-46cd-93c5-95f889a6bf41-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-03edf0f4-f9c6-46cd-93c5-95f889a6bf41-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff62552-2ab8-42b5-bf07-ea08f2ba5797]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:54 devstack sudo[102527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41
Sep 16 08:50:54 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:54 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" returned: 0 in 0.362s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:54 devstack sudo[102538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41
Sep 16 08:50:54 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:54 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" returned: 0 in 0.242s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-03edf0f4-f9c6-46cd-93c5-95f889a6bf41" released by "delete_volume" :: held 0.647s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Created reservations ['409f7dba-c50f-4ccd-907b-c97e720cea47', '6bd8cba5-e6b1-4cbc-95e7-919028619ffe', '32f22b2b-ee5d-4ccb-b486-40ad21b3b196', '00ddb634-95eb-471f-bc48-a9876ca79d4f'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:54 devstack sudo[102541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:54 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:55 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.258s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:55 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Deleted volume successfully.
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-41a1e29a-74b5-4a55-aaf1-898da30d55d0 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-03edf0f4-f9c6-46cd-93c5-95f889a6bf41-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-aff2a9bf-66d2-4d65-b4fe-e231750c6901-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-aff2a9bf-66d2-4d65-b4fe-e231750c6901-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-a947cba9-108e-4746-9e16-0ee0370d43be" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-a947cba9-108e-4746-9e16-0ee0370d43be" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-aff2a9bf-66d2-4d65-b4fe-e231750c6901" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-aff2a9bf-66d2-4d65-b4fe-e231750c6901" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Deleting offline snapshot aff2a9bf-66d2-4d65-b4fe-e231750c6901 of volume a947cba9-108e-4746-9e16-0ee0370d43be {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] snapshot_file for this snap is: volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed48654-ea24-4aa9-b55c-159cc7e4da65]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:55 devstack sudo[102544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901
Sep 16 08:50:55 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:55 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901" returned: 0 in 0.358s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a947cba9-108e-4746-9e16-0ee0370d43be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e2ed44-a7b2-4c0f-94c1-1a5d609c95f1]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:55 devstack sudo[102549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be
Sep 16 08:50:55 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:56 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be" returned: 0 in 0.534s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:56 devstack sudo[102554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901
Sep 16 08:50:56 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:56 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901" returned: 0 in 0.345s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:56 devstack sudo[102561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901
Sep 16 08:50:56 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:56 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be.aff2a9bf-66d2-4d65-b4fe-e231750c6901" returned: 0 in 0.250s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-aff2a9bf-66d2-4d65-b4fe-e231750c6901" released by "_delete_snapshot" :: held 1.587s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-a947cba9-108e-4746-9e16-0ee0370d43be" released by "delete_snapshot" :: held 1.608s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:56 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Created reservations ['22b4f14c-024c-4ef9-a38a-7247f815a2e8', '9ee7a7fa-9184-4ad3-a89e-f6afecd67945', 'a4127d9c-199c-412a-b9b7-cdbe46a8ede6', '2a5e7e6c-c9d0-4e16-b6c2-a83d45e3a765'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:56 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Delete snapshot completed successfully.
Sep 16 08:50:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-713f3707-91bc-42ea-ba19-e4ecf8d5c708 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-aff2a9bf-66d2-4d65-b4fe-e231750c6901-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-a947cba9-108e-4746-9e16-0ee0370d43be-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-a947cba9-108e-4746-9e16-0ee0370d43be-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-a947cba9-108e-4746-9e16-0ee0370d43be" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-a947cba9-108e-4746-9e16-0ee0370d43be" acquired by "delete_volume" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:57 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0983bf-ff37-4cc8-99cf-a81ddde002a6]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:57 devstack sudo[102564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be
Sep 16 08:50:57 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:57 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be" returned: 0 in 0.359s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:57 devstack sudo[102569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be
Sep 16 08:50:57 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:58 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a947cba9-108e-4746-9e16-0ee0370d43be" returned: 0 in 0.242s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-a947cba9-108e-4746-9e16-0ee0370d43be" released by "delete_volume" :: held 0.660s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Created reservations ['30383e2f-04cf-4d76-92a9-b4d31e7bc999', '211469df-bb8f-4bf6-a138-0d300d1bce80', '1012a31e-e4f5-4e72-9b22-6c3e87eb269e', '16f80e13-de8e-4591-b65f-0084d8170d81'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:58 devstack sudo[102572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:58 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:58 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.246s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:58 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Deleted volume successfully.
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44629d62-2c65-4f22-b426-14a99826e5d4 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-a947cba9-108e-4746-9e16-0ee0370d43be-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-16abd0e4-28ac-4830-87d3-0555d2d0fe0c-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-16abd0e4-28ac-4830-87d3-0555d2d0fe0c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "cinder-quobyte-16abd0e4-28ac-4830-87d3-0555d2d0fe0c" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-16abd0e4-28ac-4830-87d3-0555d2d0fe0c" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e037c3d5-c6dc-4971-a234-48751a81b047]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:50:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:58 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c
Sep 16 08:50:58 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:59 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c" returned: 0 in 0.354s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:59 devstack sudo[102580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c
Sep 16 08:50:59 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:59 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-16abd0e4-28ac-4830-87d3-0555d2d0fe0c" returned: 0 in 0.253s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-quobyte-16abd0e4-28ac-4830-87d3-0555d2d0fe0c" released by "delete_volume" :: held 0.669s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Created reservations ['daa76b41-5d5a-4106-b7ce-780a09e692f2', '34dd542c-ea15-42ac-a1a1-906f84335ca0', 'abd57f03-a1c8-4a83-a2b5-045aa727caf6', 'a16f2853-9d0f-45a5-be9b-1e3d77e6c5b2'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:50:59 devstack sudo[102583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:50:59 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:50:59 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.254s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:50:59 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Deleted volume successfully.
Sep 16 08:50:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7fd7701b-bf08-4933-a57c-737e72f3cfd2 tempest-VolumesSnapshotTestJSON-1227289177 None] Lock "cinder-16abd0e4-28ac-4830-87d3-0555d2d0fe0c-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Flow 'volume_create_manager' (276b6816-983f-419c-8f63-1baa31289c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c75ee55-9831-4d0a-a891-f037697adb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c75ee55-9831-4d0a-a891-f037697adb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1225254773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c6b4b2-7f2b-4833-9d21-1f307b8de57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958c902e68e9441badb2eb4ea52ee797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:51:07Z,use_quota=True,user_id='16e6ee274ebb49aba4a8064192bf3100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abcea1f-2f10-4b49-a58a-f6fe128424b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abcea1f-2f10-4b49-a58a-f6fe128424b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a37b1c-4347-44ff-8f00-2840ca1dfb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a37b1c-4347-44ff-8f00-2840ca1dfb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c6b4b2-7f2b-4833-9d21-1f307b8de57e', 'volume_name': 'volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7fc05e-928b-4ec9-8b91-d6c3e78907e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7fc05e-928b-4ec9-8b91-d6c3e78907e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0333df-d1ee-4a4a-8253-a2d4bac85247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:06 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Volume 56c6b4b2-7f2b-4833-9d21-1f307b8de57e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e', 'volume_size': 1}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1225254773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c6b4b2-7f2b-4833-9d21-1f307b8de57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='958c902e68e9441badb2eb4ea52ee797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:51:07Z,use_quota=True,user_id='16e6ee274ebb49aba4a8064192bf3100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Creating volume 56c6b4b2-7f2b-4833-9d21-1f307b8de57e {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:51:06 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:51:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:06 devstack sudo[102590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e 1073741824
Sep 16 08:51:06 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:07 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e 1073741824" returned: 0 in 0.402s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:07 devstack sudo[102596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e
Sep 16 08:51:07 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:07 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" returned: 0 in 0.242s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0333df-d1ee-4a4a-8253-a2d4bac85247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21232a55-f6ca-4c53-8c8a-0fa51b64156b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:07 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Volume volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e (56c6b4b2-7f2b-4833-9d21-1f307b8de57e): created successfully
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21232a55-f6ca-4c53-8c8a-0fa51b64156b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Flow 'volume_create_manager' (276b6816-983f-419c-8f63-1baa31289c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:51:07 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-513f0e26-e0c7-424c-bb6c-cc6a9a0a069c tempest-VolumesSnapshotListTestJSON-1745209000 None] Created volume successfully.
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] Creating offline snapshot e74d245b-e838-44e5-a187-5bbe2ff4ed59 of volume 56c6b4b2-7f2b-4833-9d21-1f307b8de57e {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f998eb-114e-4958-ab32-1d3874d9f5e9]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:07 devstack sudo[102599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e
Sep 16 08:51:07 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:08 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" returned: 0 in 0.349s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:08 devstack sudo[102604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 1G
Sep 16 08:51:08 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:08 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 1G" returned: 0 in 0.372s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:08 devstack sudo[102609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59
Sep 16 08:51:08 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:08 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59" returned: 0 in 0.305s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:08 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 is being set with open permissions: ugo+rw
Sep 16 08:51:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:08 devstack sudo[102614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59
Sep 16 08:51:08 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:09 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59" returned: 0 in 0.248s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:09 devstack sudo[102617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.info
Sep 16 08:51:09 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:09 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.info" returned: 0 in 0.247s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:09 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.info is being set with open permissions: ugo+rw
Sep 16 08:51:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:09 devstack sudo[102620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.info
Sep 16 08:51:09 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:09 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.info" returned: 0 in 0.240s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:09 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1f414bbf-9cbf-4c83-a2bb-64c8e4c92174 tempest-VolumesSnapshotListTestJSON-1745209000 None] Create snapshot completed successfully
Sep 16 08:51:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] Creating offline snapshot ee6e2b78-2257-4938-b359-66b44b775fda of volume 56c6b4b2-7f2b-4833-9d21-1f307b8de57e {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:51:10 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc39ae3c-d211-457d-a787-e935c019bf85]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:10 devstack sudo[102623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59
Sep 16 08:51:10 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:10 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59" returned: 0 in 0.354s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:51:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:10 devstack sudo[102628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda 1G
Sep 16 08:51:10 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:10 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda 1G" returned: 0 in 0.405s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:10 devstack sudo[102633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda
Sep 16 08:51:10 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:11 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda" returned: 0 in 0.282s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:11 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda is being set with open permissions: ugo+rw
Sep 16 08:51:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:11 devstack sudo[102638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda
Sep 16 08:51:11 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:11 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda" returned: 0 in 0.237s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.374s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:11 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9d73c723-1431-4ec9-a411-2a22e3cfe439 tempest-VolumesSnapshotListTestJSON-1745209000 None] Create snapshot completed successfully
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=138,cinder:SELECT=125,cinder:DELETE=13,cinder:INSERT=34 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=116,cinder:INSERT=37,cinder:UPDATE=153,cinder:DELETE=14 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] Creating offline snapshot d42443a6-0f04-4298-b021-205938035652 of volume 56c6b4b2-7f2b-4833-9d21-1f307b8de57e {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8610c22f-1c9c-4871-8bf3-0a93d1f56a99]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:12 devstack sudo[102642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda
Sep 16 08:51:12 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:12 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda" returned: 0 in 0.364s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:12 devstack sudo[102647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:51:12 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:12 devstack sudo[102649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652 1G
Sep 16 08:51:12 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:12 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.240s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:51:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:51:13 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652 1G" returned: 0 in 0.460s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:13 devstack sudo[102655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652
Sep 16 08:51:13 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:13 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652" returned: 0 in 0.285s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:13 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652 is being set with open permissions: ugo+rw
Sep 16 08:51:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:13 devstack sudo[102660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652
Sep 16 08:51:13 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:13 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652" returned: 0 in 0.244s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.451s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:13 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-31296bad-8bd0-47df-897c-54c2cfafa60e tempest-VolumesSnapshotListTestJSON-1745209000 None] Create snapshot completed successfully
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "cinder-d42443a6-0f04-4298-b021-205938035652-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-d42443a6-0f04-4298-b021-205938035652-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "cinder-quobyte-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "cinder-quobyte-d42443a6-0f04-4298-b021-205938035652" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-d42443a6-0f04-4298-b021-205938035652" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Deleting offline snapshot d42443a6-0f04-4298-b021-205938035652 of volume 56c6b4b2-7f2b-4833-9d21-1f307b8de57e {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] snapshot_file for this snap is: volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[284add8f-c279-4cd9-bd7f-5459379bcb12]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:15 devstack sudo[102663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652
Sep 16 08:51:15 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:15 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652" returned: 0 in 0.345s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b00677d-d3ce-4014-bf27-68e188886515]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:15 devstack sudo[102668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda
Sep 16 08:51:15 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:15 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda" returned: 0 in 0.351s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:51:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:15 devstack sudo[102673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652
Sep 16 08:51:15 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:16 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652" returned: 0 in 0.396s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:16 devstack sudo[102679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652
Sep 16 08:51:16 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:16 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.d42443a6-0f04-4298-b021-205938035652" returned: 0 in 0.240s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-d42443a6-0f04-4298-b021-205938035652" released by "_delete_snapshot" :: held 1.425s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" released by "delete_snapshot" :: held 1.449s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:16 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Created reservations ['ed0b8b2b-f5fa-4c59-abd1-7b66f98f84d1', '833ea457-a023-489a-a814-35fede9f53f4', 'ef6b5868-4740-473a-9ae6-6fd05ab3e311', 'bb6c7e05-e611-4fb0-8462-80545ce37b46'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:51:16 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Delete snapshot completed successfully.
Sep 16 08:51:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f57dc27e-835f-44ef-ab44-e2aa89405f38 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-d42443a6-0f04-4298-b021-205938035652-delete_snapshot" released by "delete_snapshot" :: held 1.576s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "cinder-ee6e2b78-2257-4938-b359-66b44b775fda-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-ee6e2b78-2257-4938-b359-66b44b775fda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "cinder-quobyte-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "cinder-quobyte-ee6e2b78-2257-4938-b359-66b44b775fda" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-ee6e2b78-2257-4938-b359-66b44b775fda" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Deleting offline snapshot ee6e2b78-2257-4938-b359-66b44b775fda of volume 56c6b4b2-7f2b-4833-9d21-1f307b8de57e {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] snapshot_file for this snap is: volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfd1095-c905-42cf-802b-f796f1f32430]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:17 devstack sudo[102682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda
Sep 16 08:51:17 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:17 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda" returned: 0 in 0.355s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0ec194-2403-46de-a47f-80b9be256f7e]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:17 devstack sudo[102687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59
Sep 16 08:51:17 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:18 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59" returned: 0 in 0.346s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:51:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:18 devstack sudo[102692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda
Sep 16 08:51:18 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:18 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda" returned: 0 in 0.363s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:18 devstack sudo[102697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda
Sep 16 08:51:18 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:18 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.ee6e2b78-2257-4938-b359-66b44b775fda" returned: 0 in 0.244s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-ee6e2b78-2257-4938-b359-66b44b775fda" released by "_delete_snapshot" :: held 1.399s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" released by "delete_snapshot" :: held 1.419s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:18 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Created reservations ['d05ff941-f6bb-4188-910e-7541029c5821', '3c8454e1-9280-4025-8e5d-f619613fd858', '6ced0993-a00e-4938-bbf9-a0d7468642d7', 'ca3dbbe9-3cf6-47ff-87a3-bf656a477e9d'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:51:18 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Delete snapshot completed successfully.
Sep 16 08:51:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2f1fe927-70dc-405d-aa7b-fcd259e13a61 tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-ee6e2b78-2257-4938-b359-66b44b775fda-delete_snapshot" released by "delete_snapshot" :: held 1.541s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "cinder-e74d245b-e838-44e5-a187-5bbe2ff4ed59-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-e74d245b-e838-44e5-a187-5bbe2ff4ed59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "cinder-quobyte-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "cinder-quobyte-e74d245b-e838-44e5-a187-5bbe2ff4ed59" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-e74d245b-e838-44e5-a187-5bbe2ff4ed59" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Deleting offline snapshot e74d245b-e838-44e5-a187-5bbe2ff4ed59 of volume 56c6b4b2-7f2b-4833-9d21-1f307b8de57e {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] snapshot_file for this snap is: volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aeb469-83c4-480a-9fb5-e6b84959ad89]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:19 devstack sudo[102700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59
Sep 16 08:51:19 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:19 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59" returned: 0 in 0.354s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fa13d4-f65e-4d7b-b7f4-fef365fc69a2]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:19 devstack sudo[102705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e
Sep 16 08:51:19 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:20 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" returned: 0 in 0.373s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:20 devstack sudo[102710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59
Sep 16 08:51:20 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:20 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59" returned: 0 in 0.327s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:20 devstack sudo[102715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59
Sep 16 08:51:20 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:20 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e.e74d245b-e838-44e5-a187-5bbe2ff4ed59" returned: 0 in 0.238s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-e74d245b-e838-44e5-a187-5bbe2ff4ed59" released by "_delete_snapshot" :: held 1.399s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" released by "delete_snapshot" :: held 1.419s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:20 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Created reservations ['e63ba4c4-4d6c-4be2-9212-85cdf4ad79da', '5fc0e20a-2820-4d00-aecc-48e77b1aa5aa', 'a7f3cfd5-9b6d-49c1-8fad-46f7a420164c', 'da03c542-0c57-4ec9-9714-35b191706815'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:51:20 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Delete snapshot completed successfully.
Sep 16 08:51:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bbd6b9e1-a274-4b87-bb95-23e26145232d tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-e74d245b-e838-44e5-a187-5bbe2ff4ed59-delete_snapshot" released by "delete_snapshot" :: held 1.541s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "cinder-56c6b4b2-7f2b-4833-9d21-1f307b8de57e-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-56c6b4b2-7f2b-4833-9d21-1f307b8de57e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "cinder-quobyte-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:21 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5aacbf-5fd1-4665-9cb6-9a67198fb94c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:21 devstack sudo[102719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e
Sep 16 08:51:21 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:22 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" returned: 0 in 0.353s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:22 devstack sudo[102724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e
Sep 16 08:51:22 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:22 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" returned: 0 in 0.241s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-quobyte-56c6b4b2-7f2b-4833-9d21-1f307b8de57e" released by "delete_volume" :: held 0.652s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Created reservations ['246f5946-6fa6-4dad-a654-6090eb6a0f6d', '4aa16801-f4ee-401f-9504-8ebd9da5fe5f', 'fe278fa0-6267-49a6-84c2-4a70b5e8237b', '88b5fdea-6fab-4326-ae21-8a9654bfd375'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:22 devstack sudo[102727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:51:22 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:22 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.243s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:51:22 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Deleted volume successfully.
Sep 16 08:51:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e64cc65a-c8d5-416c-bad9-08b6efe701de tempest-VolumesSnapshotListTestJSON-1745209000 None] Lock "cinder-56c6b4b2-7f2b-4833-9d21-1f307b8de57e-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Flow 'volume_create_manager' (31f068fe-56e3-413c-846c-b09afb7a7206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2ba334-eec8-4d2a-8e93-56ac1b4f1c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2ba334-eec8-4d2a-8e93-56ac1b4f1c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1887021798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2170b129acd1436ba4dfb28cf1164500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:51:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:51:26Z,use_quota=True,user_id='a2547bbad45048b48227088ac3092540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a352311-2c47-49f3-8229-dfd4d77323e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a352311-2c47-49f3-8229-dfd4d77323e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f14df6-1bbe-4ade-9413-dc0f360d0127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f14df6-1bbe-4ade-9413-dc0f360d0127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4', 'volume_name': 'volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4', 'volume_size': 2}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ccd4b3-84cc-414c-95db-dfa963488e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ccd4b3-84cc-414c-95db-dfa963488e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e944002-298d-46cd-9326-51ae61ef4398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:26 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Volume 569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4', 'volume_size': 2}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1887021798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2170b129acd1436ba4dfb28cf1164500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:51:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:51:26Z,use_quota=True,user_id='a2547bbad45048b48227088ac3092540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Creating volume 569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:51:26 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 2147483648 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:26 devstack sudo[102731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 2147483648
Sep 16 08:51:26 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:26 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 2147483648" returned: 0 in 0.452s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:26 devstack sudo[102736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4
Sep 16 08:51:26 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:27 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4" returned: 0 in 0.238s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e944002-298d-46cd-9326-51ae61ef4398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4', 'volume_size': 2}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d524012-0ba4-4edf-a057-004a368166a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:27 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Volume volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 (569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4): created successfully
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d524012-0ba4-4edf-a057-004a368166a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Flow 'volume_create_manager' (31f068fe-56e3-413c-846c-b09afb7a7206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:51:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b69aa6c1-8fd2-47b7-85be-380b833fc634 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Created volume successfully.
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Creating offline snapshot 994b5de1-1d7d-44ea-89e8-d13c35d59329 of volume 569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a4164a-14c8-4a75-a003-11175176e8b7]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:27 devstack sudo[102739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4
Sep 16 08:51:27 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:27 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4" returned: 0 in 0.352s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329 2G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:27 devstack sudo[102744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329 2G
Sep 16 08:51:27 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:28 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329 2G" returned: 0 in 0.392s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:28 devstack sudo[102749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329
Sep 16 08:51:28 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:28 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329" returned: 0 in 0.299s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:28 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329 is being set with open permissions: ugo+rw
Sep 16 08:51:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:28 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329
Sep 16 08:51:28 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:28 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329" returned: 0 in 0.243s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:28 devstack sudo[102757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.info
Sep 16 08:51:28 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:29 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.info" returned: 0 in 0.251s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:29 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.info is being set with open permissions: ugo+rw
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:29 devstack sudo[102760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.info
Sep 16 08:51:29 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:29 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.info" returned: 0 in 0.242s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:29 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f9b309be-b56f-49c9-92bc-30240a737e29 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Create snapshot completed successfully
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Acquiring lock "cinder-994b5de1-1d7d-44ea-89e8-d13c35d59329-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "cinder-994b5de1-1d7d-44ea-89e8-d13c35d59329-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Acquiring lock "cinder-quobyte-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "cinder-quobyte-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Acquiring lock "cinder-quobyte-994b5de1-1d7d-44ea-89e8-d13c35d59329" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "cinder-quobyte-994b5de1-1d7d-44ea-89e8-d13c35d59329" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Deleting offline snapshot 994b5de1-1d7d-44ea-89e8-d13c35d59329 of volume 569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] snapshot_file for this snap is: volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[168c7885-5eba-455b-968a-7eac4697ee48]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:29 devstack sudo[102763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329
Sep 16 08:51:29 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:30 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329" returned: 0 in 0.349s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:51:30 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7106cea1-30c5-4a65-bed8-f244ee8be2b2]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:30 devstack sudo[102768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4
Sep 16 08:51:30 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:30 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4" returned: 0 in 0.353s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:30 devstack sudo[102773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329
Sep 16 08:51:30 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:30 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329" returned: 0 in 0.326s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:30 devstack sudo[102778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329
Sep 16 08:51:30 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:31 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4.994b5de1-1d7d-44ea-89e8-d13c35d59329" returned: 0 in 0.244s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "cinder-quobyte-994b5de1-1d7d-44ea-89e8-d13c35d59329" released by "_delete_snapshot" :: held 1.374s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "cinder-quobyte-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4" released by "delete_snapshot" :: held 1.396s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:31 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Created reservations ['de78c77e-16a9-468f-a392-f41c09421e87', 'fefef0b7-34f4-417d-9cf1-51f28b668cec', '30548bbc-7bbc-4708-8ce8-5d2a9f0203cf', 'a0dbcf52-a86a-4efa-a289-36ca86dbf916'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:51:31 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Delete snapshot completed successfully.
Sep 16 08:51:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-83eb6c52-c490-472d-a977-d05f1749f7f7 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "cinder-994b5de1-1d7d-44ea-89e8-d13c35d59329-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Acquiring lock "cinder-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "cinder-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Acquiring lock "cinder-quobyte-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:51:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "cinder-quobyte-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ee8724-b42f-4f95-9c7d-7ca84ca362d4]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:32 devstack sudo[102782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4
Sep 16 08:51:32 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:32 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4" returned: 0 in 0.354s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:32 devstack sudo[102787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4
Sep 16 08:51:32 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:32 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4" returned: 0 in 0.255s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "cinder-quobyte-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4" released by "delete_volume" :: held 0.668s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Created reservations ['293f193a-3bdf-4fd5-8d66-cf6aa4bfebc0', '0d7413b4-cbf8-412b-88e1-5b6e23943ff6', '1253ed19-cbd4-46f7-ba01-c3231d8134e8', 'e05b26c1-26ed-4b46-8b24-ea00f1473970'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:32 devstack sudo[102790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:51:32 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:33 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.238s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:33 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:51:33 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Deleted volume successfully.
Sep 16 08:51:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-408542f5-53ef-4824-96b5-5c97f34db6c6 tempest-VolumesSnapshotNegativeTestJSON-600470813 None] Lock "cinder-569abccf-f0f8-4ab1-a5d7-cfd1373fa4c4-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:51:51 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=37,cinder:UPDATE=44,cinder:DELETE=2,cinder:INSERT=11 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:51:51 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=39,cinder:INSERT=15,cinder:UPDATE=43,cinder:DELETE=3 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Flow 'volume_create_manager' (cd410462-0e9f-4b84-af26-2c119832a47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f838d199-b674-484a-bb0c-934178b3e269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f838d199-b674-484a-bb0c-934178b3e269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1395642901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff632b30d81d496b94c067020f6a6cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:51:55Z,use_quota=True,user_id='b88f59b1380548b6859fe6caab8032da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dd8865-2dd8-43b8-ae0d-2d3d2ba13072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dd8865-2dd8-43b8-ae0d-2d3d2ba13072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f056380-118b-45da-a438-30c35b9b5ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f056380-118b-45da-a438-30c35b9b5ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e', 'volume_name': 'volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7401490a-55cc-43ff-8558-3a29fb071581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7401490a-55cc-43ff-8558-3a29fb071581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7140835a-b119-4d6d-997b-acf139d20f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:54 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Volume 7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e', 'volume_size': 1}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1395642901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff632b30d81d496b94c067020f6a6cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:51:55Z,use_quota=True,user_id='b88f59b1380548b6859fe6caab8032da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Creating volume 7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:51:54 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:51:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:54 devstack sudo[102841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e 1073741824
Sep 16 08:51:54 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Flow 'volume_create_manager' (4f9e5f99-e72c-48c4-96b2-1002bbc192d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bc7ad0-97fb-440d-b3e4-b9f37ade2208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bc7ad0-97fb-440d-b3e4-b9f37ade2208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1425599186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ad2242-1b05-4609-93d8-97f1f297dbef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff632b30d81d496b94c067020f6a6cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:51:55Z,use_quota=True,user_id='b88f59b1380548b6859fe6caab8032da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8061d127-cf82-4436-a83b-d5978924bb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8061d127-cf82-4436-a83b-d5978924bb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554dc1e8-209d-444e-8eff-ed58089d6566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554dc1e8-209d-444e-8eff-ed58089d6566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ad2242-1b05-4609-93d8-97f1f297dbef', 'volume_name': 'volume-e0ad2242-1b05-4609-93d8-97f1f297dbef', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf331c5-260a-4227-8ffa-adbf14b4328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf331c5-260a-4227-8ffa-adbf14b4328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c07515-aede-436c-b4af-65522dde948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:55 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Volume e0ad2242-1b05-4609-93d8-97f1f297dbef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ad2242-1b05-4609-93d8-97f1f297dbef', 'volume_size': 1}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:55 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e 1073741824" returned: 0 in 0.513s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:55 devstack sudo[102846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e
Sep 16 08:51:55 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:55 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e" returned: 0 in 0.260s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.460s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1425599186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ad2242-1b05-4609-93d8-97f1f297dbef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff632b30d81d496b94c067020f6a6cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:51:55Z,use_quota=True,user_id='b88f59b1380548b6859fe6caab8032da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Creating volume e0ad2242-1b05-4609-93d8-97f1f297dbef {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:51:55 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e0ad2242-1b05-4609-93d8-97f1f297dbef 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7140835a-b119-4d6d-997b-acf139d20f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:55 devstack sudo[102849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e0ad2242-1b05-4609-93d8-97f1f297dbef 1073741824
Sep 16 08:51:55 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4f5c8c-3d69-438f-961e-ec92c84c2b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:55 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Volume volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e (7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e): created successfully
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4f5c8c-3d69-438f-961e-ec92c84c2b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:55 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Flow 'volume_create_manager' (cd410462-0e9f-4b84-af26-2c119832a47a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:51:55 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-88c43e29-5463-4ea8-8315-a8e3eaf02341 tempest-TestServerVolumeAttachmentScenario-363949292 None] Created volume successfully.
Sep 16 08:51:56 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e0ad2242-1b05-4609-93d8-97f1f297dbef 1073741824" returned: 0 in 0.472s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e0ad2242-1b05-4609-93d8-97f1f297dbef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:51:56 devstack sudo[102855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e0ad2242-1b05-4609-93d8-97f1f297dbef
Sep 16 08:51:56 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:51:56 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root
Sep 16 08:51:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e0ad2242-1b05-4609-93d8-97f1f297dbef" returned: 0 in 0.259s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:51:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:51:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:51:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c07515-aede-436c-b4af-65522dde948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ad2242-1b05-4609-93d8-97f1f297dbef', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5920913e-f853-4752-92ce-b84880c3a4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:51:56 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Volume volume-e0ad2242-1b05-4609-93d8-97f1f297dbef (e0ad2242-1b05-4609-93d8-97f1f297dbef): created successfully
Sep 16 08:51:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5920913e-f853-4752-92ce-b84880c3a4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:51:56 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Flow 'volume_create_manager' (4f9e5f99-e72c-48c4-96b2-1002bbc192d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:51:56 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9ea9faf4-b484-471b-a6b5-547463b8edca tempest-TestServerVolumeAttachmentScenario-363949292 None] Created volume successfully.
Sep 16 08:52:06 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:52:06 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:52:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:52:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:52:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:52:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:52:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:52:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:52:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:52:12 devstack sudo[102950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:52:12 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:52:12 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root
Sep 16 08:52:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.244s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:52:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:52:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:52:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:52:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:52:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-ef39359b-da6a-4923-973d-9b29356d730f req-59832dcd-00ca-429e-8229-5f54e3f3734a tempest-TestServerVolumeAttachmentScenario-363949292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:52:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-ef39359b-da6a-4923-973d-9b29356d730f req-59832dcd-00ca-429e-8229-5f54e3f3734a tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:52:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-ef39359b-da6a-4923-973d-9b29356d730f req-59832dcd-00ca-429e-8229-5f54e3f3734a tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:52:25 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-ef39359b-da6a-4923-973d-9b29356d730f req-59832dcd-00ca-429e-8229-5f54e3f3734a tempest-TestServerVolumeAttachmentScenario-363949292 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16c7b630-b626-4a33-92cc-b7c4314c3413', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:52:25 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-ef39359b-da6a-4923-973d-9b29356d730f req-59832dcd-00ca-429e-8229-5f54e3f3734a tempest-TestServerVolumeAttachmentScenario-363949292 None] attachment_update completed successfully.
Sep 16 08:52:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-b6d173b6-2500-47ed-a8bf-b48083b55761 req-66424f17-27c7-46be-9e6a-c94757966734 tempest-TestServerVolumeAttachmentScenario-363949292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:52:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-b6d173b6-2500-47ed-a8bf-b48083b55761 req-66424f17-27c7-46be-9e6a-c94757966734 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:52:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [req-b6d173b6-2500-47ed-a8bf-b48083b55761 req-66424f17-27c7-46be-9e6a-c94757966734 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:52:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-b6d173b6-2500-47ed-a8bf-b48083b55761 req-66424f17-27c7-46be-9e6a-c94757966734 tempest-TestServerVolumeAttachmentScenario-363949292 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9', 'name': 'volume-e0ad2242-1b05-4609-93d8-97f1f297dbef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67325c34-15b6-4308-a590-04d243ef3917', 'enforce_multipath': True} {{(pid=86261) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 08:52:29 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-b6d173b6-2500-47ed-a8bf-b48083b55761 req-66424f17-27c7-46be-9e6a-c94757966734 tempest-TestServerVolumeAttachmentScenario-363949292 None] attachment_update completed successfully.
Sep 16 08:52:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-62c38c90-4a6d-4e6d-af5e-d41df99c8c31 req-9d6595a2-6b08-405e-8224-71e5ff8d66c3 tempest-TestServerVolumeAttachmentScenario-363949292 None] Terminate volume connection completed successfully.
Sep 16 08:52:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-62c38c90-4a6d-4e6d-af5e-d41df99c8c31 req-9d6595a2-6b08-405e-8224-71e5ff8d66c3 tempest-TestServerVolumeAttachmentScenario-363949292 None] Deleting attachment 67325c34-15b6-4308-a590-04d243ef3917. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:52:32 devstack cinder-volume[86261]: INFO cinder.volume.manager [req-2d1aa463-b99f-4e57-a92e-2bcf376a54cb req-db3be3ef-0e5e-4167-bf4c-bafe0c7ca283 tempest-TestServerVolumeAttachmentScenario-363949292 None] Terminate volume connection completed successfully.
Sep 16 08:52:32 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [req-2d1aa463-b99f-4e57-a92e-2bcf376a54cb req-db3be3ef-0e5e-4167-bf4c-bafe0c7ca283 tempest-TestServerVolumeAttachmentScenario-363949292 None] Deleting attachment 16c7b630-b626-4a33-92cc-b7c4314c3413. {{(pid=86261) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 08:52:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Acquiring lock "cinder-e0ad2242-1b05-4609-93d8-97f1f297dbef-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:52:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "cinder-e0ad2242-1b05-4609-93d8-97f1f297dbef-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:52:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Acquiring lock "cinder-quobyte-e0ad2242-1b05-4609-93d8-97f1f297dbef" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:52:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "cinder-quobyte-e0ad2242-1b05-4609-93d8-97f1f297dbef" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:52:36 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab39b63-1703-483a-af80-d9482be66e38]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:52:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e0ad2242-1b05-4609-93d8-97f1f297dbef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:52:36 devstack sudo[103464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e0ad2242-1b05-4609-93d8-97f1f297dbef
Sep 16 08:52:36 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:52:37 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e0ad2242-1b05-4609-93d8-97f1f297dbef" returned: 0 in 0.350s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e0ad2242-1b05-4609-93d8-97f1f297dbef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:52:37 devstack sudo[103470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e0ad2242-1b05-4609-93d8-97f1f297dbef
Sep 16 08:52:37 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:52:37 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-e0ad2242-1b05-4609-93d8-97f1f297dbef" returned: 0 in 0.239s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "cinder-quobyte-e0ad2242-1b05-4609-93d8-97f1f297dbef" released by "delete_volume" :: held 0.628s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Created reservations ['d6125391-a1f0-44fe-a601-fc4315faf925', '824f8534-3145-4b6c-b99b-f3fdfeed71ab', '5462e1d2-0664-4dd4-bc00-600a32b2d897', '3dc79184-9334-4a31-aa47-05751464523d'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:52:37 devstack sudo[103473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:52:37 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:52:37 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.244s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:52:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Deleted volume successfully.
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a2f656b7-1140-48c6-ab17-aa92e2d105d0 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "cinder-e0ad2242-1b05-4609-93d8-97f1f297dbef-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Acquiring lock "cinder-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "cinder-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Acquiring lock "cinder-quobyte-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "cinder-quobyte-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a5f21e-9469-4386-979f-d044b69f462a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:52:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:52:38 devstack sudo[103476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e
Sep 16 08:52:38 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:52:38 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e" returned: 0 in 0.356s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:52:38 devstack sudo[103481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e
Sep 16 08:52:38 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:52:38 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e" returned: 0 in 0.251s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "cinder-quobyte-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e" released by "delete_volume" :: held 0.648s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Created reservations ['b8036702-56cc-47cd-b269-f39a4307f335', '69fd6881-ad4a-4c36-973e-74e135e48d3d', '1a8761bb-59c3-49f9-840d-8fac704a0bb5', 'c8d8cefe-6a68-430e-9877-1b1f01c08c5d'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:52:38 devstack sudo[103484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:52:38 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:52:38 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.252s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:52:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Deleted volume successfully.
Sep 16 08:52:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0759cf1f-e36f-48d4-9fd0-226e18a90937 tempest-TestServerVolumeAttachmentScenario-363949292 None] Lock "cinder-7c95fec3-05fe-4c1c-9aa4-7d2560bddb8e-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:52:48 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=21,cinder:UPDATE=21,cinder:INSERT=5 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:52:48 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=29,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Flow 'volume_create_manager' (ca08d174-3d88-4931-8707-222304c91e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bf51e2-c120-404a-a84d-43eb602d2000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bf51e2-c120-404a-a84d-43eb602d2000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-796354640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c961126-a762-432d-bc74-0ceb32915e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2c9208133642099c69fecc29b903a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:53:09Z,use_quota=True,user_id='2a81ca3ce19f4ad999d5315970bf91a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bb4fea-d0b6-44ef-a79a-0285529951f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bb4fea-d0b6-44ef-a79a-0285529951f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605fd2aa-bfb0-4d66-951d-d78d477c3a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605fd2aa-bfb0-4d66-951d-d78d477c3a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c961126-a762-432d-bc74-0ceb32915e1d', 'volume_name': 'volume-7c961126-a762-432d-bc74-0ceb32915e1d', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbb6e71-f853-4d39-ad7e-8934fba0831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbb6e71-f853-4d39-ad7e-8934fba0831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9e97a1-3c63-4979-8442-2d7427b83a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:08 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Volume 7c961126-a762-432d-bc74-0ceb32915e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c961126-a762-432d-bc74-0ceb32915e1d', 'volume_size': 1}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-796354640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c961126-a762-432d-bc74-0ceb32915e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2c9208133642099c69fecc29b903a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:53:09Z,use_quota=True,user_id='2a81ca3ce19f4ad999d5315970bf91a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Creating volume 7c961126-a762-432d-bc74-0ceb32915e1d {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:53:08 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:53:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:08 devstack sudo[103541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d 1073741824
Sep 16 08:53:08 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:09 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d 1073741824" returned: 0 in 0.407s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:09 devstack sudo[103547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d
Sep 16 08:53:09 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:09 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d" returned: 0 in 0.245s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:53:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:53:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9e97a1-3c63-4979-8442-2d7427b83a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c961126-a762-432d-bc74-0ceb32915e1d', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c682f97-0207-4a83-98c4-e7d32bff09db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:09 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Volume volume-7c961126-a762-432d-bc74-0ceb32915e1d (7c961126-a762-432d-bc74-0ceb32915e1d): created successfully
Sep 16 08:53:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c682f97-0207-4a83-98c4-e7d32bff09db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Flow 'volume_create_manager' (ca08d174-3d88-4931-8707-222304c91e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:53:09 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2a913718-b35f-4cef-a5bc-0b3fba018edd tempest-TestImageHashVerification-1034026053 None] Created volume successfully.
Sep 16 08:53:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:53:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:53:10 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f485c6-0656-439c-b19a-fc270fadb53d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:53:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:10 devstack sudo[103550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d
Sep 16 08:53:10 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:10 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d" returned: 0 in 0.358s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:10 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1499a2-e2e0-4adf-9b0f-cce9e2adcd02]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:53:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:10 devstack sudo[103555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d
Sep 16 08:53:10 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:11 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d" returned: 0 in 0.354s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d /opt/stack/data/cinder/conversion/7c961126-a762-432d-bc74-0ceb32915e1d.temp_image.e8405f97-ee3f-4902-8b09-99e09b1fa88d1iym790k.img {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:11 devstack sudo[103560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d /opt/stack/data/cinder/conversion/7c961126-a762-432d-bc74-0ceb32915e1d.temp_image.e8405f97-ee3f-4902-8b09-99e09b1fa88d1iym790k.img
Sep 16 08:53:11 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:53:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:53:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:53:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:53:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:53:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:53:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:12 devstack sudo[103574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:53:12 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:12 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.352s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:53:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:53:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:53:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:53:16 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d /opt/stack/data/cinder/conversion/7c961126-a762-432d-bc74-0ceb32915e1d.temp_image.e8405f97-ee3f-4902-8b09-99e09b1fa88d1iym790k.img" returned: 0 in 5.636s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:16 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb396445-88f7-4e5b-8091-4ad8a2457f8f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:53:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:16 devstack sudo[103577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d
Sep 16 08:53:16 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:17 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d" returned: 0 in 0.534s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:17 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/conversion/7c961126-a762-432d-bc74-0ceb32915e1d.temp_image.e8405f97-ee3f-4902-8b09-99e09b1fa88d1iym790k.img {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:53:17 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] Converted 1024.00 MB image at 181.65 MB/s
Sep 16 08:53:17 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] e8405f97-ee3f-4902-8b09-99e09b1fa88d was raw, no need to convert to raw {{(pid=86261) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 16 08:53:20 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:53:27 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:53:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.668s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:53:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] Uploaded volume to glance image-id: e8405f97-ee3f-4902-8b09-99e09b1fa88d. {{(pid=86261) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 16 08:53:35 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-54ce3937-142f-478d-b11a-47b90598cd6c tempest-TestImageHashVerification-1034026053 None] Copy volume to image completed successfully.
Sep 16 08:53:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Acquiring lock "cinder-7c961126-a762-432d-bc74-0ceb32915e1d-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:53:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Lock "cinder-7c961126-a762-432d-bc74-0ceb32915e1d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:53:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Acquiring lock "cinder-quobyte-7c961126-a762-432d-bc74-0ceb32915e1d" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:53:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Lock "cinder-quobyte-7c961126-a762-432d-bc74-0ceb32915e1d" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:53:35 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ec387e-d69d-47f4-ab5a-e4de5af39261]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:53:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:36 devstack sudo[103584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d
Sep 16 08:53:36 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:36 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d" returned: 0 in 0.356s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:36 devstack sudo[103589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d
Sep 16 08:53:36 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:36 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7c961126-a762-432d-bc74-0ceb32915e1d" returned: 0 in 0.244s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Lock "cinder-quobyte-7c961126-a762-432d-bc74-0ceb32915e1d" released by "delete_volume" :: held 0.639s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Created reservations ['8646f9b2-9372-43a4-8c63-d6a09a9233ea', 'a4f23d82-5091-484b-b0f9-3f425d1982da', '05c6919d-175b-42c8-8280-b9d74bd7913c', 'ee5dc474-7af9-4855-b3e5-128040f0fa14'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:36 devstack sudo[103592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:53:36 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:36 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.239s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:53:36 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Deleted volume successfully.
Sep 16 08:53:36 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5ce9893e-d9b2-460c-8f15-adc21927f783 tempest-TestImageHashVerification-1034026053 None] Lock "cinder-7c961126-a762-432d-bc74-0ceb32915e1d-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Flow 'volume_create_manager' (924f4065-6256-406b-9a7a-561366982b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0d6e63-7c46-4f6a-bd06-7a8a2214d015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0d6e63-7c46-4f6a-bd06-7a8a2214d015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-887099342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff540006-3c13-434c-adae-a6259848872d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaddea58e13404da6430bb63cbafb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:53:48Z,use_quota=True,user_id='711e4cd01066493085759f53d7e17210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308f61e7-8552-430d-83ec-c80843503394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308f61e7-8552-430d-83ec-c80843503394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c5b74d-9df2-466a-a462-1f8ccc51a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c5b74d-9df2-466a-a462-1f8ccc51a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff540006-3c13-434c-adae-a6259848872d', 'volume_name': 'volume-ff540006-3c13-434c-adae-a6259848872d', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f37a86-9187-496e-82ba-e4097d3e0f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f37a86-9187-496e-82ba-e4097d3e0f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c803690-223f-4ec7-837d-d8324da09c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:47 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Volume ff540006-3c13-434c-adae-a6259848872d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff540006-3c13-434c-adae-a6259848872d', 'volume_size': 1}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-887099342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff540006-3c13-434c-adae-a6259848872d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaddea58e13404da6430bb63cbafb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:53:48Z,use_quota=True,user_id='711e4cd01066493085759f53d7e17210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Creating volume ff540006-3c13-434c-adae-a6259848872d {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:53:47 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:53:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:47 devstack sudo[103640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d 1073741824
Sep 16 08:53:47 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:48 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d 1073741824" returned: 0 in 0.417s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:48 devstack sudo[103646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d
Sep 16 08:53:48 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:48 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d" returned: 0 in 0.248s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c803690-223f-4ec7-837d-d8324da09c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff540006-3c13-434c-adae-a6259848872d', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc4bf95-c7d1-4bda-b9b7-0c03203ba089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:48 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Volume volume-ff540006-3c13-434c-adae-a6259848872d (ff540006-3c13-434c-adae-a6259848872d): created successfully
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc4bf95-c7d1-4bda-b9b7-0c03203ba089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Flow 'volume_create_manager' (924f4065-6256-406b-9a7a-561366982b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:53:48 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-6d75e634-da9a-4ecc-a608-388d7ec35099 tempest-VolumeDependencyTests-753836576 None] Created volume successfully.
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] Creating offline snapshot 6bb8fa3e-a95e-4a96-81e5-e704473ace56 of volume ff540006-3c13-434c-adae-a6259848872d {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c02c30-9898-4e1d-9ab3-c4da2f88b028]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:53:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:49 devstack sudo[103649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d
Sep 16 08:53:49 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:49 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d" returned: 0 in 0.357s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:49 devstack sudo[103654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56 1G
Sep 16 08:53:49 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:49 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56 1G" returned: 0 in 0.386s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff540006-3c13-434c-adae-a6259848872d -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:49 devstack sudo[103659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff540006-3c13-434c-adae-a6259848872d -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56
Sep 16 08:53:49 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:49 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff540006-3c13-434c-adae-a6259848872d -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56" returned: 0 in 0.283s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:49 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56 is being set with open permissions: ugo+rw
Sep 16 08:53:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:49 devstack sudo[103665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56
Sep 16 08:53:49 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:50 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56" returned: 0 in 0.246s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:50 devstack sudo[103668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.info
Sep 16 08:53:50 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:50 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.info" returned: 0 in 0.251s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:50 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.info is being set with open permissions: ugo+rw
Sep 16 08:53:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:50 devstack sudo[103671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.info
Sep 16 08:53:50 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:50 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.info" returned: 0 in 0.243s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:53:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0e594f40-e27d-4c29-8eea-f17d4b3188ae tempest-VolumeDependencyTests-753836576 None] Create snapshot completed successfully
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Flow 'volume_create_manager' (5d4c3577-fb85-4a6a-9abf-c75732ad9c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f361a9-787e-4185-8cac-443753f1082f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f361a9-787e-4185-8cac-443753f1082f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-283905935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e041ea1-d275-47db-9588-73ad8944acc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aaddea58e13404da6430bb63cbafb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6bb8fa3e-a95e-4a96-81e5-e704473ace56,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:53:51Z,use_quota=True,user_id='711e4cd01066493085759f53d7e17210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a8088d-2a25-4fe7-a459-a150ebcba3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a8088d-2a25-4fe7-a459-a150ebcba3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde406f2-2719-4824-a948-df5f7dca65b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde406f2-2719-4824-a948-df5f7dca65b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e041ea1-d275-47db-9588-73ad8944acc5', 'volume_name': 'volume-1e041ea1-d275-47db-9588-73ad8944acc5', 'volume_size': 1, 'snapshot_id': '6bb8fa3e-a95e-4a96-81e5-e704473ace56'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d14e8b-f39f-4cab-bb62-e5c2a93bfcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d14e8b-f39f-4cab-bb62-e5c2a93bfcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72d6a98-09ff-4f7f-a077-7d601ceed97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:51 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Volume 1e041ea1-d275-47db-9588-73ad8944acc5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e041ea1-d275-47db-9588-73ad8944acc5', 'volume_size': 1, 'snapshot_id': '6bb8fa3e-a95e-4a96-81e5-e704473ace56'}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "cinder-quobyte-6bb8fa3e-a95e-4a96-81e5-e704473ace56-1e041ea1-d275-47db-9588-73ad8944acc5" by "_create_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-quobyte-6bb8fa3e-a95e-4a96-81e5-e704473ace56-1e041ea1-d275-47db-9588-73ad8944acc5" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Creating volume 1e041ea1-d275-47db-9588-73ad8944acc5 from snapshot 6bb8fa3e-a95e-4a96-81e5-e704473ace56 {{(pid=86261) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "cinder-quobyte-1e041ea1-d275-47db-9588-73ad8944acc5" by "_copy_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-quobyte-1e041ea1-d275-47db-9588-73ad8944acc5" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] snapshot: 6bb8fa3e-a95e-4a96-81e5-e704473ace56, volume: 1e041ea1-d275-47db-9588-73ad8944acc5,  {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a63c61c-4e55-49ed-baad-9a85065c9bb3]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:51 devstack sudo[103674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56
Sep 16 08:53:51 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:51 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56" returned: 0 in 0.358s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff540006-3c13-434c-adae-a6259848872d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02a242b-f81b-4c37-bbdb-657eda6ed13d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:53:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:52 devstack sudo[103680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d
Sep 16 08:53:52 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:52 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d" returned: 0 in 0.358s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 08:53:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Creating direct copy from snapshot {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 08:53:52 devstack cinder-volume[86261]: DEBUG cinder.utils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Path /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5 not found in is_blk_device check {{(pid=86261) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 08:53:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:52 devstack sudo[103685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5
Sep 16 08:53:52 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:58 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5" returned: 0 in 5.975s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:53:58 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Converted 1024.00 MB image at 171.34 MB/s
Sep 16 08:53:58 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5 is being set with open permissions: ugo+rw
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:58 devstack sudo[103705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5
Sep 16 08:53:58 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:58 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5" returned: 0 in 0.240s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-quobyte-1e041ea1-d275-47db-9588-73ad8944acc5" released by "_copy_volume_from_snapshot" :: held 7.011s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-quobyte-6bb8fa3e-a95e-4a96-81e5-e704473ace56-1e041ea1-d275-47db-9588-73ad8944acc5" released by "_create_volume_from_snapshot" :: held 7.067s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.082s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72d6a98-09ff-4f7f-a077-7d601ceed97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e041ea1-d275-47db-9588-73ad8944acc5', 'volume_size': 1, 'snapshot_id': '6bb8fa3e-a95e-4a96-81e5-e704473ace56'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc10e57e-3a1a-4e44-911d-ec7db86161a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:53:58 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Volume volume-1e041ea1-d275-47db-9588-73ad8944acc5 (1e041ea1-d275-47db-9588-73ad8944acc5): created successfully
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc10e57e-3a1a-4e44-911d-ec7db86161a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Flow 'volume_create_manager' (5d4c3577-fb85-4a6a-9abf-c75732ad9c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:53:58 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5a986c22-1870-4171-ace3-0ab0cdee2614 tempest-VolumeDependencyTests-753836576 None] Created volume successfully.
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "cinder-6bb8fa3e-a95e-4a96-81e5-e704473ace56-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-6bb8fa3e-a95e-4a96-81e5-e704473ace56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "cinder-quobyte-ff540006-3c13-434c-adae-a6259848872d" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-quobyte-ff540006-3c13-434c-adae-a6259848872d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "cinder-quobyte-6bb8fa3e-a95e-4a96-81e5-e704473ace56" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-quobyte-6bb8fa3e-a95e-4a96-81e5-e704473ace56" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Deleting offline snapshot 6bb8fa3e-a95e-4a96-81e5-e704473ace56 of volume ff540006-3c13-434c-adae-a6259848872d {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] snapshot_file for this snap is: volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53f53ba-16a6-46f7-a31e-5c847a6a2e98]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:53:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:59 devstack sudo[103708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56
Sep 16 08:53:59 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:59 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56" returned: 0 in 0.344s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff540006-3c13-434c-adae-a6259848872d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:53:59 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa4c85d-1599-49b8-a944-364df837a5fb]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:53:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:59 devstack sudo[103713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d
Sep 16 08:53:59 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:53:59 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root
Sep 16 08:53:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d" returned: 0 in 0.525s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:53:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:53:59 devstack sudo[103718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56
Sep 16 08:53:59 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:00 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:00 devstack sudo[103725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56
Sep 16 08:54:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56" returned: 0 in 0.316s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:00 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:00 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d.6bb8fa3e-a95e-4a96-81e5-e704473ace56" returned: 0 in 0.250s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:00 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-quobyte-6bb8fa3e-a95e-4a96-81e5-e704473ace56" released by "_delete_snapshot" :: held 1.535s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:00 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-quobyte-ff540006-3c13-434c-adae-a6259848872d" released by "delete_snapshot" :: held 1.556s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:00 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Created reservations ['d08624eb-aec4-422d-b429-a9b3f894a172', '5c0ee84d-0fb6-4402-9e2d-070b7195b344', '6aa87c23-eebb-4043-a390-5999e25cc7b0', '2994f190-0061-4b4f-8c6a-13e82766fb2b'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:54:00 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Delete snapshot completed successfully.
Sep 16 08:54:00 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e23d80e8-64fd-4517-8527-b6c444f8a3a5 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-6bb8fa3e-a95e-4a96-81e5-e704473ace56-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "cinder-ff540006-3c13-434c-adae-a6259848872d-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-ff540006-3c13-434c-adae-a6259848872d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "cinder-quobyte-ff540006-3c13-434c-adae-a6259848872d" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-quobyte-ff540006-3c13-434c-adae-a6259848872d" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e3ddb3-a35b-4fe2-9398-58665b36018d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:01 devstack sudo[103729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d
Sep 16 08:54:01 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:01 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d" returned: 0 in 0.352s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:01 devstack sudo[103735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d
Sep 16 08:54:01 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:01 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ff540006-3c13-434c-adae-a6259848872d" returned: 0 in 0.249s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-quobyte-ff540006-3c13-434c-adae-a6259848872d" released by "delete_volume" :: held 0.660s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Created reservations ['96f7ff57-7fcf-4feb-8494-bd2400fc932e', '3c1e1e0c-aeec-493b-9d0a-de6dd7f5f029', '7d1f3c9d-a163-4f46-b1c4-5a8d163dd656', '95405173-57c5-46c2-98ee-64ea5ea37948'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:54:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:01 devstack sudo[103739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:54:01 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:02 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.242s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:54:02 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Deleted volume successfully.
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80265ccc-a61a-4521-a2b1-381707a92db3 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-ff540006-3c13-434c-adae-a6259848872d-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "cinder-1e041ea1-d275-47db-9588-73ad8944acc5-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-1e041ea1-d275-47db-9588-73ad8944acc5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "cinder-quobyte-1e041ea1-d275-47db-9588-73ad8944acc5" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-quobyte-1e041ea1-d275-47db-9588-73ad8944acc5" acquired by "delete_volume" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ec8f9b-2f39-4951-8c4f-3cf6a0f20342]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:02 devstack sudo[103742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5
Sep 16 08:54:02 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:02 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5" returned: 0 in 0.356s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:02 devstack sudo[103747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5
Sep 16 08:54:02 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:02 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e041ea1-d275-47db-9588-73ad8944acc5" returned: 0 in 0.245s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-quobyte-1e041ea1-d275-47db-9588-73ad8944acc5" released by "delete_volume" :: held 0.640s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:02 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Created reservations ['35a6f79d-acd3-4b7d-b1ba-01ef5794f4d1', 'fb05b3f3-93f5-4db3-a06b-623256fadc84', 'f13d515e-5ac3-4092-9576-1cbce6744101', 'dd7419fb-fd6b-4a77-af79-4b40acf80e1f'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:54:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:54:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:54:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:54:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:54:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:54:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:03 devstack sudo[103750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:54:03 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:03 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.244s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:03 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:54:03 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Deleted volume successfully.
Sep 16 08:54:03 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-35fd6e49-e99d-4bf0-ad01-6248ac2abee3 tempest-VolumeDependencyTests-753836576 None] Lock "cinder-1e041ea1-d275-47db-9588-73ad8944acc5-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:54:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:54:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:54:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:54:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:54:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:54:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:12 devstack sudo[103755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:54:12 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:12 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.242s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:54:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:54:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:54:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:54:13 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=30,cinder:UPDATE=40,cinder:INSERT=13,cinder:DELETE=2 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:54:13 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=36,cinder:SELECT=31,cinder:INSERT=6,cinder:DELETE=4 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Flow 'volume_create_manager' (626e8a50-f7e8-4d85-94be-eb7624cc2c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e40bc5-288b-4c9a-badc-f5da3206d1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e40bc5-288b-4c9a-badc-f5da3206d1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-968460345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1156b7bc-04ba-4312-835d-a9edf9035736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14364af144f64ae1a17cc3613025c2b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:54:26Z,use_quota=True,user_id='8f4d758cc88940ff95bc9dad552d8837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3b1da9-f0ad-4c5b-9543-0e830941b087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3b1da9-f0ad-4c5b-9543-0e830941b087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c35b7b-0769-4094-bb1f-d0180e7c2c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c35b7b-0769-4094-bb1f-d0180e7c2c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1156b7bc-04ba-4312-835d-a9edf9035736', 'volume_name': 'volume-1156b7bc-04ba-4312-835d-a9edf9035736', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2373243-ab51-478b-8404-46ca5a813638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2373243-ab51-478b-8404-46ca5a813638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7995710-1052-4ff6-8267-fb6a6c9119b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:54:26 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Volume 1156b7bc-04ba-4312-835d-a9edf9035736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1156b7bc-04ba-4312-835d-a9edf9035736', 'volume_size': 1}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-968460345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1156b7bc-04ba-4312-835d-a9edf9035736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14364af144f64ae1a17cc3613025c2b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:54:26Z,use_quota=True,user_id='8f4d758cc88940ff95bc9dad552d8837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Creating volume 1156b7bc-04ba-4312-835d-a9edf9035736 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:54:26 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:26 devstack sudo[103760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 1073741824
Sep 16 08:54:26 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:26 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 1073741824" returned: 0 in 0.419s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:26 devstack sudo[103765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736
Sep 16 08:54:26 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:27 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736" returned: 0 in 0.256s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7995710-1052-4ff6-8267-fb6a6c9119b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1156b7bc-04ba-4312-835d-a9edf9035736', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa9a763-a00c-4185-9d7d-45607ca730a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:54:27 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Volume volume-1156b7bc-04ba-4312-835d-a9edf9035736 (1156b7bc-04ba-4312-835d-a9edf9035736): created successfully
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa9a763-a00c-4185-9d7d-45607ca730a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Flow 'volume_create_manager' (626e8a50-f7e8-4d85-94be-eb7624cc2c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:54:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bbc8addb-2af5-493f-a9a0-13a0a20319f9 tempest-SnapshotDependencyTests-99982668 None] Created volume successfully.
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] Creating offline snapshot cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 of volume 1156b7bc-04ba-4312-835d-a9edf9035736 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b340f82-4abf-49e5-b428-93e3b13cf9a6]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:27 devstack sudo[103769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736
Sep 16 08:54:27 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:27 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736" returned: 0 in 0.357s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:27 devstack sudo[103774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 1G
Sep 16 08:54:27 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:28 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 1G" returned: 0 in 0.379s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1156b7bc-04ba-4312-835d-a9edf9035736 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:28 devstack sudo[103779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1156b7bc-04ba-4312-835d-a9edf9035736 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7
Sep 16 08:54:28 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:28 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1156b7bc-04ba-4312-835d-a9edf9035736 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7" returned: 0 in 0.297s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:28 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 is being set with open permissions: ugo+rw
Sep 16 08:54:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:28 devstack sudo[103784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7
Sep 16 08:54:28 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:28 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7" returned: 0 in 0.238s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:28 devstack sudo[103787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.info
Sep 16 08:54:28 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:29 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.info" returned: 0 in 0.246s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:29 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.info is being set with open permissions: ugo+rw
Sep 16 08:54:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:29 devstack sudo[103790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.info
Sep 16 08:54:29 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:29 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.info" returned: 0 in 0.234s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:54:29 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-81f7818d-cf41-4a27-a9cc-fe11790b6e22 tempest-SnapshotDependencyTests-99982668 None] Create snapshot completed successfully
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Flow 'volume_create_manager' (f932eeab-c78d-413c-a15c-a52802be1ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2813f60a-51ea-4a45-b06a-e6e75a98ca73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2813f60a-51ea-4a45-b06a-e6e75a98ca73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c59d970-a710-4ec4-b07a-884420cb0b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14364af144f64ae1a17cc3613025c2b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:54:30Z,use_quota=True,user_id='8f4d758cc88940ff95bc9dad552d8837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff15466-bd74-420f-82cb-4bcfb39aaafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff15466-bd74-420f-82cb-4bcfb39aaafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071b3672-33ff-463d-8b8e-7b903cab158f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071b3672-33ff-463d-8b8e-7b903cab158f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c59d970-a710-4ec4-b07a-884420cb0b93', 'volume_name': 'volume-3c59d970-a710-4ec4-b07a-884420cb0b93', 'volume_size': 1, 'snapshot_id': 'cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246b0369-15d4-4f73-8581-34fbf49d5424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246b0369-15d4-4f73-8581-34fbf49d5424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c3337c-a9c5-4f97-8735-e4d91ebad194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:54:30 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Volume 3c59d970-a710-4ec4-b07a-884420cb0b93: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c59d970-a710-4ec4-b07a-884420cb0b93', 'volume_size': 1, 'snapshot_id': 'cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7'}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "cinder-quobyte-cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7-3c59d970-a710-4ec4-b07a-884420cb0b93" by "_create_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-quobyte-cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7-3c59d970-a710-4ec4-b07a-884420cb0b93" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Creating volume 3c59d970-a710-4ec4-b07a-884420cb0b93 from snapshot cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 {{(pid=86261) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "cinder-quobyte-3c59d970-a710-4ec4-b07a-884420cb0b93" by "_copy_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-quobyte-3c59d970-a710-4ec4-b07a-884420cb0b93" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] snapshot: cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7, volume: 3c59d970-a710-4ec4-b07a-884420cb0b93,  {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa3d161-900e-45d7-b544-6f2811511aaf]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:30 devstack sudo[103793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7
Sep 16 08:54:30 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:30 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7" returned: 0 in 0.351s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1156b7bc-04ba-4312-835d-a9edf9035736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff2c14c-bf19-4b9b-9ae7-440a5beac686]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:54:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:30 devstack sudo[103798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736
Sep 16 08:54:30 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:31 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736" returned: 0 in 0.341s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 08:54:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Creating direct copy from snapshot {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 08:54:31 devstack cinder-volume[86261]: DEBUG cinder.utils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Path /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93 not found in is_blk_device check {{(pid=86261) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 08:54:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:31 devstack sudo[103803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93
Sep 16 08:54:31 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:36 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93" returned: 0 in 5.884s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:36 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:54:36 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Converted 1024.00 MB image at 173.96 MB/s
Sep 16 08:54:36 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93 is being set with open permissions: ugo+rw
Sep 16 08:54:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:36 devstack sudo[103818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93
Sep 16 08:54:36 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:37 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93" returned: 0 in 0.238s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-quobyte-3c59d970-a710-4ec4-b07a-884420cb0b93" released by "_copy_volume_from_snapshot" :: held 6.891s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-quobyte-cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7-3c59d970-a710-4ec4-b07a-884420cb0b93" released by "_create_volume_from_snapshot" :: held 6.953s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.967s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c3337c-a9c5-4f97-8735-e4d91ebad194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c59d970-a710-4ec4-b07a-884420cb0b93', 'volume_size': 1, 'snapshot_id': 'cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903a0b6a-1bde-4db7-874c-7eea17ff4b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:54:37 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Volume volume-3c59d970-a710-4ec4-b07a-884420cb0b93 (3c59d970-a710-4ec4-b07a-884420cb0b93): created successfully
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903a0b6a-1bde-4db7-874c-7eea17ff4b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Flow 'volume_create_manager' (f932eeab-c78d-413c-a15c-a52802be1ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:54:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c0cc404f-a437-4a8b-bfc6-61bb8610d84a tempest-SnapshotDependencyTests-99982668 None] Created volume successfully.
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "cinder-cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "cinder-quobyte-1156b7bc-04ba-4312-835d-a9edf9035736" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-quobyte-1156b7bc-04ba-4312-835d-a9edf9035736" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "cinder-quobyte-cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-quobyte-cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Deleting offline snapshot cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 of volume 1156b7bc-04ba-4312-835d-a9edf9035736 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] snapshot_file for this snap is: volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ab0309-32e4-4938-910a-0857bb5fb119]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:54:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:37 devstack sudo[103821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7
Sep 16 08:54:37 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:38 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7" returned: 0 in 0.354s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1156b7bc-04ba-4312-835d-a9edf9035736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:54:38 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[841d8750-45ab-4b69-83ab-60923adc238b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:54:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:38 devstack sudo[103826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736
Sep 16 08:54:38 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:38 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736" returned: 0 in 0.537s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:38 devstack sudo[103831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7
Sep 16 08:54:38 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:39 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7" returned: 0 in 0.325s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:39 devstack sudo[103836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7
Sep 16 08:54:39 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:39 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736.cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7" returned: 0 in 0.241s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-quobyte-cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7" released by "_delete_snapshot" :: held 1.558s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-quobyte-1156b7bc-04ba-4312-835d-a9edf9035736" released by "delete_snapshot" :: held 1.578s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:39 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Created reservations ['f9c9335e-62ea-4d89-a8e8-c983104d77ab', 'da29ce83-63ab-4109-b27c-e82b14222a42', 'fb8a465c-117a-4480-955b-fdcefe30f7df', '72dd25f3-68eb-4b68-95be-47b1a6684de2'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:54:39 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Delete snapshot completed successfully.
Sep 16 08:54:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f93669b9-d6fa-4bdd-a553-1ce252a808cf tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-cdc665fc-ee5d-44b9-b713-1e8a8b8c42e7-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "cinder-1156b7bc-04ba-4312-835d-a9edf9035736-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-1156b7bc-04ba-4312-835d-a9edf9035736-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "cinder-quobyte-1156b7bc-04ba-4312-835d-a9edf9035736" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-quobyte-1156b7bc-04ba-4312-835d-a9edf9035736" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ab5675-d3c4-4208-b618-4eff962a153a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:40 devstack sudo[103841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736
Sep 16 08:54:40 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:40 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736" returned: 0 in 0.354s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:40 devstack sudo[103846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736
Sep 16 08:54:40 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:40 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1156b7bc-04ba-4312-835d-a9edf9035736" returned: 0 in 0.244s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-quobyte-1156b7bc-04ba-4312-835d-a9edf9035736" released by "delete_volume" :: held 0.663s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Created reservations ['f84006fd-609b-4ad0-9318-d0872e91dc7b', 'd3c2df67-c62c-4b5a-ba49-c9d4567e8bfe', 'ea5cc782-9a42-45c6-a11d-9361d87b959c', '0a4fa9a5-eafc-45cc-a407-3305beef2b1d'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:54:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:40 devstack sudo[103849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:54:40 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:41 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.256s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:54:41 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Deleted volume successfully.
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bd5dec8c-e892-424c-bbea-0abaab9a6366 tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-1156b7bc-04ba-4312-835d-a9edf9035736-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "cinder-3c59d970-a710-4ec4-b07a-884420cb0b93-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-3c59d970-a710-4ec4-b07a-884420cb0b93-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "cinder-quobyte-3c59d970-a710-4ec4-b07a-884420cb0b93" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-quobyte-3c59d970-a710-4ec4-b07a-884420cb0b93" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3170b5b4-ed4a-4c2b-a5c5-086bc755eb3c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:41 devstack sudo[103852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93
Sep 16 08:54:41 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:41 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93" returned: 0 in 0.360s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:41 devstack sudo[103857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93
Sep 16 08:54:41 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:41 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-3c59d970-a710-4ec4-b07a-884420cb0b93" returned: 0 in 0.245s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-quobyte-3c59d970-a710-4ec4-b07a-884420cb0b93" released by "delete_volume" :: held 0.645s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Created reservations ['3ef7117e-d129-4e73-9a0b-606334740c17', '18e199d2-bb91-4172-8565-334781154bff', 'b1104039-90be-4c9d-9c22-6dd6cab2d82b', '302365aa-6eae-422c-ae11-c8b9106e1089'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:54:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:54:41 devstack sudo[103861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:54:41 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:54:42 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root
Sep 16 08:54:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.241s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:54:42 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:54:42 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Deleted volume successfully.
Sep 16 08:54:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-413afca3-d0f6-4483-a8aa-e4ea5c54cd9c tempest-SnapshotDependencyTests-99982668 None] Lock "cinder-3c59d970-a710-4ec4-b07a-884420cb0b93-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:54:51 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=29,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:54:52 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=32,cinder:SELECT=20,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Flow 'volume_create_manager' (5a5f6788-a420-4636-a43c-00239fc22038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a08414-4373-4342-8574-f221ae4b08ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a08414-4373-4342-8574-f221ae4b08ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1577668059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69516fec-60f4-4440-9309-214932d2ac21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa67a6b0bc4453c9648c4c9ecb730c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:02Z,use_quota=True,user_id='c5c9d2831cc44bdd820614ecad39a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2b133f-d399-4a35-92f5-df0d42297101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2b133f-d399-4a35-92f5-df0d42297101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a002ba22-42e3-48c7-ad61-ae115326d9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a002ba22-42e3-48c7-ad61-ae115326d9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69516fec-60f4-4440-9309-214932d2ac21', 'volume_name': 'volume-69516fec-60f4-4440-9309-214932d2ac21', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (472493b6-b505-4d04-86a7-434c23e86f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (472493b6-b505-4d04-86a7-434c23e86f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19543d7c-1be8-4f0a-aaa4-31d3735c9ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:02 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume 69516fec-60f4-4440-9309-214932d2ac21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69516fec-60f4-4440-9309-214932d2ac21', 'volume_size': 1}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1577668059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69516fec-60f4-4440-9309-214932d2ac21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa67a6b0bc4453c9648c4c9ecb730c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:02Z,use_quota=True,user_id='c5c9d2831cc44bdd820614ecad39a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Creating volume 69516fec-60f4-4440-9309-214932d2ac21 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:02 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-69516fec-60f4-4440-9309-214932d2ac21 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:02 devstack sudo[103953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-69516fec-60f4-4440-9309-214932d2ac21 1073741824
Sep 16 08:55:02 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Flow 'volume_create_manager' (e8b4aaa8-92c6-4c03-bd83-b8a9f1e5fe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c853b1-a969-4be3-93b1-8c1d46cd06a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c853b1-a969-4be3-93b1-8c1d46cd06a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692735051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d8f806-e9d3-4c7f-abcf-a1ce9608bacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94932a32cb4f1fa4558d70bb6ec6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:03Z,use_quota=True,user_id='d42a00abdaa34c4584b77bb4012117b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c4d761-4f6d-4dfb-b786-bf8bb216e7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c4d761-4f6d-4dfb-b786-bf8bb216e7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727a9ac3-720a-4d7f-b1dc-8c2e6e3e9fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727a9ac3-720a-4d7f-b1dc-8c2e6e3e9fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d8f806-e9d3-4c7f-abcf-a1ce9608bacd', 'volume_name': 'volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc1930d-384c-4139-8a27-f462cef45fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc1930d-384c-4139-8a27-f462cef45fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a1e05c-b519-428f-99f3-859ef2fd63cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:02 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume 52d8f806-e9d3-4c7f-abcf-a1ce9608bacd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd', 'volume_size': 1}
Sep 16 08:55:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:03 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Flow 'volume_create_manager' (5b9c32cc-aa9c-47bb-a631-896e6e6adf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f62eb4f-e1cf-4c25-8a68-feed74be01a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-69516fec-60f4-4440-9309-214932d2ac21 1073741824" returned: 0 in 0.695s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f62eb4f-e1cf-4c25-8a68-feed74be01a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1605017740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd3cb96-4e91-4eb6-9e30-d92c08f45b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884ac16c916c404e84e67a27538cc8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:03Z,use_quota=True,user_id='29d257cc056c4b1285a565cc7150b62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce628605-22cf-46da-9eec-85725d177d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce628605-22cf-46da-9eec-85725d177d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0126e41e-ab6e-4983-a02f-fcba7477a366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0126e41e-ab6e-4983-a02f-fcba7477a366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cd3cb96-4e91-4eb6-9e30-d92c08f45b76', 'volume_name': 'volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd7ee38e-7007-42d2-8485-064b35a3a747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd7ee38e-7007-42d2-8485-064b35a3a747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11533e1d-6d87-43af-a423-b043afdb043c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:03 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Volume 5cd3cb96-4e91-4eb6-9e30-d92c08f45b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76', 'volume_size': 1}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-69516fec-60f4-4440-9309-214932d2ac21 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:03 devstack sudo[103959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-69516fec-60f4-4440-9309-214932d2ac21
Sep 16 08:55:03 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:03 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-69516fec-60f4-4440-9309-214932d2ac21" returned: 0 in 0.389s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692735051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d8f806-e9d3-4c7f-abcf-a1ce9608bacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94932a32cb4f1fa4558d70bb6ec6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:03Z,use_quota=True,user_id='d42a00abdaa34c4584b77bb4012117b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Creating volume 52d8f806-e9d3-4c7f-abcf-a1ce9608bacd {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:03 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19543d7c-1be8-4f0a-aaa4-31d3735c9ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69516fec-60f4-4440-9309-214932d2ac21', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:03 devstack sudo[103963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd 1073741824
Sep 16 08:55:03 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd5d93f-0c38-4f20-91d9-0a9b1906bfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Flow 'volume_create_manager' (e8e872ed-2c97-4e7e-be51-4e466e46da6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb19d1a3-6387-475d-8189-4d971968f4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:03 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume volume-69516fec-60f4-4440-9309-214932d2ac21 (69516fec-60f4-4440-9309-214932d2ac21): created successfully
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd5d93f-0c38-4f20-91d9-0a9b1906bfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Flow 'volume_create_manager' (5a5f6788-a420-4636-a43c-00239fc22038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb19d1a3-6387-475d-8189-4d971968f4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-625966161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4d8f03-e319-409a-a810-9c564dcdf390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884ac16c916c404e84e67a27538cc8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:04Z,use_quota=True,user_id='29d257cc056c4b1285a565cc7150b62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f29dc57-d79e-4cd8-aca8-486981712c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f29dc57-d79e-4cd8-aca8-486981712c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2123e405-b9e6-4353-baf1-9d0d41af99cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2123e405-b9e6-4353-baf1-9d0d41af99cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d4d8f03-e319-409a-a810-9c564dcdf390', 'volume_name': 'volume-5d4d8f03-e319-409a-a810-9c564dcdf390', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f897be28-164b-43e2-875e-df63909ae642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f897be28-164b-43e2-875e-df63909ae642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8529d44-d737-4732-bfb9-cda6513f0ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:03 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Volume 5d4d8f03-e319-409a-a810-9c564dcdf390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d4d8f03-e319-409a-a810-9c564dcdf390', 'volume_size': 1}
Sep 16 08:55:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:03 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-cc6e8740-af11-4f33-baf9-29569c14dfdb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Created volume successfully.
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Flow 'volume_create_manager' (43e47a71-7a45-4b45-8be5-5bfa214f9bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ac5547-61b0-42ef-8797-c1bfed02ea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ac5547-61b0-42ef-8797-c1bfed02ea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841661125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62a431b-e5ef-46e4-8df7-350dd0e6fdf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884ac16c916c404e84e67a27538cc8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:04Z,use_quota=True,user_id='29d257cc056c4b1285a565cc7150b62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (736fec16-105e-46ff-aa3c-c9342d8ef8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (736fec16-105e-46ff-aa3c-c9342d8ef8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012ec0fe-7a61-4af7-8523-6bc1d67d4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012ec0fe-7a61-4af7-8523-6bc1d67d4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62a431b-e5ef-46e4-8df7-350dd0e6fdf2', 'volume_name': 'volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bea89a4-ceee-46f1-a4f9-18bb156a48dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bea89a4-ceee-46f1-a4f9-18bb156a48dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185e5981-2337-4441-a0e6-da82790f09ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:04 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Volume d62a431b-e5ef-46e4-8df7-350dd0e6fdf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2', 'volume_size': 1}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:04 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd 1073741824" returned: 0 in 0.641s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:04 devstack sudo[103969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd
Sep 16 08:55:04 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Flow 'volume_create_manager' (5decb597-9c91-40aa-b51d-7ea38a91ba41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f872ea-a2f8-4c4c-94df-d2ff996147de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f872ea-a2f8-4c4c-94df-d2ff996147de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-930764952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df163250-6219-4a42-b32d-6ab9b66d6aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884ac16c916c404e84e67a27538cc8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:04Z,use_quota=True,user_id='29d257cc056c4b1285a565cc7150b62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea40c472-97c1-4c16-9eab-f1db29469ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea40c472-97c1-4c16-9eab-f1db29469ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a5adc1-9fa8-4873-adf9-48469a716c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a5adc1-9fa8-4873-adf9-48469a716c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df163250-6219-4a42-b32d-6ab9b66d6aef', 'volume_name': 'volume-df163250-6219-4a42-b32d-6ab9b66d6aef', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd3452a-f0a6-4d31-bf09-df5a25b430af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dd3452a-f0a6-4d31-bf09-df5a25b430af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b890d6-c8fb-4e23-988e-a43fb51edde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:04 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Volume df163250-6219-4a42-b32d-6ab9b66d6aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df163250-6219-4a42-b32d-6ab9b66d6aef', 'volume_size': 1}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:04 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd" returned: 0 in 0.449s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.576s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1605017740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd3cb96-4e91-4eb6-9e30-d92c08f45b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884ac16c916c404e84e67a27538cc8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:03Z,use_quota=True,user_id='29d257cc056c4b1285a565cc7150b62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Creating volume 5cd3cb96-4e91-4eb6-9e30-d92c08f45b76 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:04 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:04 devstack sudo[103972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76 1073741824
Sep 16 08:55:04 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a1e05c-b519-428f-99f3-859ef2fd63cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:04 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c199a5b9-a6fa-4b38-a7bc-75b6f75b1bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:04 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd (52d8f806-e9d3-4c7f-abcf-a1ce9608bacd): created successfully
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c199a5b9-a6fa-4b38-a7bc-75b6f75b1bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Flow 'volume_create_manager' (e8b4aaa8-92c6-4c03-bd83-b8a9f1e5fe16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Flow 'volume_create_manager' (404e9dd1-947b-4c93-94bf-7d92c6b93855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae04f854-7347-430f-a3d7-6fec9d2c7de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-388ae226-ae67-43fe-8fd6-1b9ff1bfc247 tempest-CreateVolumesFromSnapshotTest-286226697 None] Created volume successfully.
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae04f854-7347-430f-a3d7-6fec9d2c7de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1435323257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cecfa73-1339-4cf9-88c9-b1917120d640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884ac16c916c404e84e67a27538cc8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:05Z,use_quota=True,user_id='29d257cc056c4b1285a565cc7150b62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fff9ae0-c925-46ea-8dd9-5619bbcbedc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fff9ae0-c925-46ea-8dd9-5619bbcbedc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f8e72a-9785-416d-a666-57b6f187e1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f8e72a-9785-416d-a666-57b6f187e1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cecfa73-1339-4cf9-88c9-b1917120d640', 'volume_name': 'volume-4cecfa73-1339-4cf9-88c9-b1917120d640', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a5a41a-ffa1-4c4c-b1b7-f2b3b74a1f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9a5a41a-ffa1-4c4c-b1b7-f2b3b74a1f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2348d914-be42-462f-b1ec-ddb554a8cbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Volume 4cecfa73-1339-4cf9-88c9-b1917120d640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cecfa73-1339-4cf9-88c9-b1917120d640', 'volume_size': 1}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Flow 'volume_create_manager' (eff12dbb-0b71-4d59-b44c-8ab5ca602a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e30752e-b1ea-434b-bd0c-7025fe48d15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e30752e-b1ea-434b-bd0c-7025fe48d15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-618982082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390a4ece-7bd3-4642-87c0-1443593f3cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa67a6b0bc4453c9648c4c9ecb730c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:05Z,use_quota=True,user_id='c5c9d2831cc44bdd820614ecad39a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8303bf-8d0c-4e8d-a880-5b6cdba7d697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8303bf-8d0c-4e8d-a880-5b6cdba7d697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eebf53c-5353-43bb-b598-049c5ec2978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eebf53c-5353-43bb-b598-049c5ec2978e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '390a4ece-7bd3-4642-87c0-1443593f3cce', 'volume_name': 'volume-390a4ece-7bd3-4642-87c0-1443593f3cce', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86a7621-820b-4317-a4ab-134f10dd275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86a7621-820b-4317-a4ab-134f10dd275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84fd137-3a96-4a88-8c50-d34a4ae82b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume 390a4ece-7bd3-4642-87c0-1443593f3cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-390a4ece-7bd3-4642-87c0-1443593f3cce', 'volume_size': 1}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:05 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76 1073741824" returned: 0 in 0.688s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:05 devstack sudo[103978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76
Sep 16 08:55:05 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Flow 'volume_create_manager' (6260df53-74e1-475f-98dc-6c9c19125796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5b5e79-f88f-4f07-b7c0-3cdd6126ec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5b5e79-f88f-4f07-b7c0-3cdd6126ec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-11928118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26616991-6c6e-4619-bc0b-491e2da627d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa67a6b0bc4453c9648c4c9ecb730c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:06Z,use_quota=True,user_id='c5c9d2831cc44bdd820614ecad39a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d0acf1-e961-478c-844d-e479db73ad91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d0acf1-e961-478c-844d-e479db73ad91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf08c36-35e8-4eb3-b244-a014beded650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf08c36-35e8-4eb3-b244-a014beded650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26616991-6c6e-4619-bc0b-491e2da627d5', 'volume_name': 'volume-26616991-6c6e-4619-bc0b-491e2da627d5', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea002414-496e-4099-b62d-9f50e9433365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea002414-496e-4099-b62d-9f50e9433365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f58d1a8-0921-44be-9595-3f2b4377ad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:05 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume 26616991-6c6e-4619-bc0b-491e2da627d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26616991-6c6e-4619-bc0b-491e2da627d5', 'volume_size': 1}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76" returned: 0 in 0.360s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.072s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-625966161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4d8f03-e319-409a-a810-9c564dcdf390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884ac16c916c404e84e67a27538cc8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:04Z,use_quota=True,user_id='29d257cc056c4b1285a565cc7150b62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Creating volume 5d4d8f03-e319-409a-a810-9c564dcdf390 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:06 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5d4d8f03-e319-409a-a810-9c564dcdf390 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11533e1d-6d87-43af-a423-b043afdb043c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc3b5c0-7e71-4dbb-94ef-7bff06faa486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:06 devstack sudo[103981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5d4d8f03-e319-409a-a810-9c564dcdf390 1073741824
Sep 16 08:55:06 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:06 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Volume volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76 (5cd3cb96-4e91-4eb6-9e30-d92c08f45b76): created successfully
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc3b5c0-7e71-4dbb-94ef-7bff06faa486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Flow 'volume_create_manager' (5b9c32cc-aa9c-47bb-a631-896e6e6adf5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:06 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-64511d94-cf86-4254-a066-64753d0518ff tempest-CreateVolumesFromImageTest-614897086 None] Created volume successfully.
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Flow 'volume_create_manager' (92421351-10aa-47d5-b85e-bfb3d5560900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7cddaf-aa11-437a-9e01-4b0c2b2ebb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7cddaf-aa11-437a-9e01-4b0c2b2ebb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1136441153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1105850b-bf5c-4a4c-9344-d249e26d9f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa67a6b0bc4453c9648c4c9ecb730c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:06Z,use_quota=True,user_id='c5c9d2831cc44bdd820614ecad39a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec85c0f-75c2-457b-9173-a98cd1b90d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec85c0f-75c2-457b-9173-a98cd1b90d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdf8345-f0a6-47a2-ba58-ebfa8fc1d83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdf8345-f0a6-47a2-ba58-ebfa8fc1d83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1105850b-bf5c-4a4c-9344-d249e26d9f55', 'volume_name': 'volume-1105850b-bf5c-4a4c-9344-d249e26d9f55', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc61539-2f30-4135-a63d-8e20f90d0402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc61539-2f30-4135-a63d-8e20f90d0402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5e1429-c562-4a86-9063-c69c767cb3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:06 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume 1105850b-bf5c-4a4c-9344-d249e26d9f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1105850b-bf5c-4a4c-9344-d249e26d9f55', 'volume_size': 1}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:06 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5d4d8f03-e319-409a-a810-9c564dcdf390 1073741824" returned: 0 in 0.768s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Flow 'volume_create_manager' (d6b28ac2-3f10-4b5f-bf21-3b21664c8963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90723b3-1385-4c45-b439-e839b243248a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5d4d8f03-e319-409a-a810-9c564dcdf390 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:06 devstack sudo[104043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5d4d8f03-e319-409a-a810-9c564dcdf390
Sep 16 08:55:06 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90723b3-1385-4c45-b439-e839b243248a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022305827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51fa6924-1ff6-4209-ab1d-dd75dedd1555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa67a6b0bc4453c9648c4c9ecb730c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:07Z,use_quota=True,user_id='c5c9d2831cc44bdd820614ecad39a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca03efa8-fdd3-4173-bcc7-ad552f278bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca03efa8-fdd3-4173-bcc7-ad552f278bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:06 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581e57c6-9805-4282-813f-a58b42995cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581e57c6-9805-4282-813f-a58b42995cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51fa6924-1ff6-4209-ab1d-dd75dedd1555', 'volume_name': 'volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768d8534-875f-4051-bbe8-86cd9ed44491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768d8534-875f-4051-bbe8-86cd9ed44491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298dd3a2-8f26-4059-82f9-31eee8f77867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume 51fa6924-1ff6-4209-ab1d-dd75dedd1555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555', 'volume_size': 1}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:07 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Flow 'volume_create_manager' (32fd51d1-2705-4122-87e5-6fc8d1043dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ae10ca-1e8e-4870-8168-f0ccbb2190d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5d4d8f03-e319-409a-a810-9c564dcdf390" returned: 0 in 0.485s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.137s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841661125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62a431b-e5ef-46e4-8df7-350dd0e6fdf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884ac16c916c404e84e67a27538cc8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:04Z,use_quota=True,user_id='29d257cc056c4b1285a565cc7150b62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Creating volume d62a431b-e5ef-46e4-8df7-350dd0e6fdf2 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:07 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ae10ca-1e8e-4870-8168-f0ccbb2190d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1645459540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b51304b-c847-4429-b7d9-4120431cf545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa67a6b0bc4453c9648c4c9ecb730c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:07Z,use_quota=True,user_id='c5c9d2831cc44bdd820614ecad39a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:07 devstack sudo[104238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2 1073741824
Sep 16 08:55:07 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f8d7f0-cce1-46f9-b288-0520189e27d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f8d7f0-cce1-46f9-b288-0520189e27d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc57815a-213d-4278-a071-d21725575425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc57815a-213d-4278-a071-d21725575425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b51304b-c847-4429-b7d9-4120431cf545', 'volume_name': 'volume-5b51304b-c847-4429-b7d9-4120431cf545', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e81472-e939-43b3-85f6-537d2f5e4bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e81472-e939-43b3-85f6-537d2f5e4bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3247af54-e5ca-4cc2-b9bc-20e54a5ee7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume 5b51304b-c847-4429-b7d9-4120431cf545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b51304b-c847-4429-b7d9-4120431cf545', 'volume_size': 1}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8529d44-d737-4732-bfb9-cda6513f0ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d4d8f03-e319-409a-a810-9c564dcdf390', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4802f8-7dd4-46c9-8e7f-075c851e5d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Volume volume-5d4d8f03-e319-409a-a810-9c564dcdf390 (5d4d8f03-e319-409a-a810-9c564dcdf390): created successfully
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4802f8-7dd4-46c9-8e7f-075c851e5d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Flow 'volume_create_manager' (e8e872ed-2c97-4e7e-be51-4e466e46da6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:07 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ce620862-6f06-4953-aa8b-dcb2967eaef1 tempest-CreateVolumesFromImageTest-614897086 None] Created volume successfully.
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Flow 'volume_create_manager' (e7be3710-b641-44f8-af3f-d33c57e423a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc018ed-e6cd-4e30-baba-9e919c8db61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc018ed-e6cd-4e30-baba-9e919c8db61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9f0b0d-c476-41ba-852c-8519149e08b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2474a73b0e054cdd85e8e9ef7551772a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:08Z,use_quota=True,user_id='9660eb80a3f64001855e5d79b855bb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(165f2889-4246-4a50-b914-e534150c9466),volume_type_id=165f2889-4246-4a50-b914-e534150c9466)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682df52d-77c6-445f-b8af-6def37ab341b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682df52d-77c6-445f-b8af-6def37ab341b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e414623d-27af-4acb-a17f-9eed392cd1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.image.glance [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Creating Keystone auth plugin from conf {{(pid=86261) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e414623d-27af-4acb-a17f-9eed392cd1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d9f0b0d-c476-41ba-852c-8519149e08b5', 'volume_name': 'volume-4d9f0b0d-c476-41ba-852c-8519149e08b5', 'volume_size': 1, 'image_id': 'cf531690-eba1-40cd-99d9-74a0c2a81d57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf531690-eba1-40cd-99d9-74a0c2a81d57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b93c03e582a15d0a0057633897e2101', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2474a73b0e054cdd85e8e9ef7551772a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '02387f911a36e68f493df53055fc7976ec799a68180da03fc2d0c1868ac4f794d88d9d5166460890612f3f055d290605ecf590b02f6b726a26a8eea45201b9ca', 'id': 'cf531690-eba1-40cd-99d9-74a0c2a81d57', 'created_at': datetime.datetime(2026, 9, 16, 6, 55, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 55, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf531690-eba1-40cd-99d9-74a0c2a81d57/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef14aab0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b5f6c0-563e-40b9-979c-470dd27773ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b5f6c0-563e-40b9-979c-470dd27773ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4111d903-4c5a-471b-bcc2-fa1b655415c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:07 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Volume 4d9f0b0d-c476-41ba-852c-8519149e08b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d9f0b0d-c476-41ba-852c-8519149e08b5', 'volume_size': 1, 'image_id': 'cf531690-eba1-40cd-99d9-74a0c2a81d57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf531690-eba1-40cd-99d9-74a0c2a81d57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b93c03e582a15d0a0057633897e2101', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2474a73b0e054cdd85e8e9ef7551772a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '02387f911a36e68f493df53055fc7976ec799a68180da03fc2d0c1868ac4f794d88d9d5166460890612f3f055d290605ecf590b02f6b726a26a8eea45201b9ca', 'id': 'cf531690-eba1-40cd-99d9-74a0c2a81d57', 'created_at': datetime.datetime(2026, 9, 16, 6, 55, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 55, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf531690-eba1-40cd-99d9-74a0c2a81d57/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef14aab0>}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Trying to clone 4d9f0b0d-c476-41ba-852c-8519149e08b5 from image cf531690-eba1-40cd-99d9-74a0c2a81d57 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf531690-eba1-40cd-99d9-74a0c2a81d57', 'metadata': {}}]). {{(pid=86261) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 08:55:07 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2 1073741824" returned: 0 in 0.522s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:08 devstack sudo[104325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2
Sep 16 08:55:08 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 08:55:08 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9baee8-8de2-41c1-a83d-60125a0fbb28]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:08 devstack sudo[104327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD
Sep 16 08:55:08 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:08 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2" returned: 0 in 0.274s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.486s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-930764952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df163250-6219-4a42-b32d-6ab9b66d6aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884ac16c916c404e84e67a27538cc8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:04Z,use_quota=True,user_id='29d257cc056c4b1285a565cc7150b62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Creating volume df163250-6219-4a42-b32d-6ab9b66d6aef {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:08 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-df163250-6219-4a42-b32d-6ab9b66d6aef 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185e5981-2337-4441-a0e6-da82790f09ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:08 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-df163250-6219-4a42-b32d-6ab9b66d6aef 1073741824
Sep 16 08:55:08 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03350d42-19f7-41db-82da-48a8058de3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:08 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Volume volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2 (d62a431b-e5ef-46e4-8df7-350dd0e6fdf2): created successfully
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03350d42-19f7-41db-82da-48a8058de3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Flow 'volume_create_manager' (43e47a71-7a45-4b45-8be5-5bfa214f9bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:08 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-964edede-577c-420c-828d-1916cd771afd tempest-CreateVolumesFromImageTest-614897086 None] Created volume successfully.
Sep 16 08:55:08 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:08 devstack sudo[104334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD
Sep 16 08:55:08 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:08 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-df163250-6219-4a42-b32d-6ab9b66d6aef 1073741824" returned: 0 in 0.496s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-df163250-6219-4a42-b32d-6ab9b66d6aef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:08 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD" returned: 1 in 0.356s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Temporary image cf531690-eba1-40cd-99d9-74a0c2a81d57 is fetched for user 9660eb80a3f64001855e5d79b855bb76. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 08:55:08 devstack sudo[104342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-df163250-6219-4a42-b32d-6ab9b66d6aef
Sep 16 08:55:08 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7a165c-c0e7-4793-83bb-2e5ac4bde1e1]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:08 devstack sudo[104344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD
Sep 16 08:55:08 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:09 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-df163250-6219-4a42-b32d-6ab9b66d6aef" returned: 0 in 0.248s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.869s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1435323257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cecfa73-1339-4cf9-88c9-b1917120d640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='884ac16c916c404e84e67a27538cc8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:05Z,use_quota=True,user_id='29d257cc056c4b1285a565cc7150b62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Creating volume 4cecfa73-1339-4cf9-88c9-b1917120d640 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:09 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4cecfa73-1339-4cf9-88c9-b1917120d640 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b890d6-c8fb-4e23-988e-a43fb51edde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df163250-6219-4a42-b32d-6ab9b66d6aef', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:09 devstack sudo[104347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4cecfa73-1339-4cf9-88c9-b1917120d640 1073741824
Sep 16 08:55:09 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24570f40-b8e3-4c03-99e9-b889a1b423ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:09 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Volume volume-df163250-6219-4a42-b32d-6ab9b66d6aef (df163250-6219-4a42-b32d-6ab9b66d6aef): created successfully
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24570f40-b8e3-4c03-99e9-b889a1b423ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Flow 'volume_create_manager' (5decb597-9c91-40aa-b51d-7ea38a91ba41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:09 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b2f776f5-c5b5-4a50-811e-496cdcf02c8a tempest-CreateVolumesFromImageTest-614897086 None] Created volume successfully.
Sep 16 08:55:09 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:09 devstack sudo[104351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD
Sep 16 08:55:09 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:09 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD" returned: 1 in 0.326s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:09 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4cecfa73-1339-4cf9-88c9-b1917120d640 1073741824" returned: 0 in 0.483s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4cecfa73-1339-4cf9-88c9-b1917120d640 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:09 devstack sudo[104360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4cecfa73-1339-4cf9-88c9-b1917120d640
Sep 16 08:55:09 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:09 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4cecfa73-1339-4cf9-88c9-b1917120d640" returned: 0 in 0.237s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.321s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-618982082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390a4ece-7bd3-4642-87c0-1443593f3cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa67a6b0bc4453c9648c4c9ecb730c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:05Z,use_quota=True,user_id='c5c9d2831cc44bdd820614ecad39a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Creating volume 390a4ece-7bd3-4642-87c0-1443593f3cce {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:09 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-390a4ece-7bd3-4642-87c0-1443593f3cce 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2348d914-be42-462f-b1ec-ddb554a8cbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cecfa73-1339-4cf9-88c9-b1917120d640', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:09 devstack sudo[104363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-390a4ece-7bd3-4642-87c0-1443593f3cce 1073741824
Sep 16 08:55:09 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b729b1cb-16a7-4fe6-8617-e241326e21dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:09 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Volume volume-4cecfa73-1339-4cf9-88c9-b1917120d640 (4cecfa73-1339-4cf9-88c9-b1917120d640): created successfully
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b729b1cb-16a7-4fe6-8617-e241326e21dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Flow 'volume_create_manager' (404e9dd1-947b-4c93-94bf-7d92c6b93855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:09 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3b19c1c8-85fc-4db4-8d90-a229cc3c2261 tempest-CreateVolumesFromImageTest-614897086 None] Created volume successfully.
Sep 16 08:55:10 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-390a4ece-7bd3-4642-87c0-1443593f3cce 1073741824" returned: 0 in 0.420s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-390a4ece-7bd3-4642-87c0-1443593f3cce {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:10 devstack sudo[104369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-390a4ece-7bd3-4642-87c0-1443593f3cce
Sep 16 08:55:10 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:10 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-390a4ece-7bd3-4642-87c0-1443593f3cce" returned: 0 in 0.242s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.552s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-11928118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26616991-6c6e-4619-bc0b-491e2da627d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa67a6b0bc4453c9648c4c9ecb730c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:06Z,use_quota=True,user_id='c5c9d2831cc44bdd820614ecad39a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Creating volume 26616991-6c6e-4619-bc0b-491e2da627d5 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:10 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-26616991-6c6e-4619-bc0b-491e2da627d5 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:10 devstack sudo[104372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-26616991-6c6e-4619-bc0b-491e2da627d5 1073741824
Sep 16 08:55:10 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84fd137-3a96-4a88-8c50-d34a4ae82b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390a4ece-7bd3-4642-87c0-1443593f3cce', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523320fb-43c3-4615-8334-4e1bc3102f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:10 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume volume-390a4ece-7bd3-4642-87c0-1443593f3cce (390a4ece-7bd3-4642-87c0-1443593f3cce): created successfully
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523320fb-43c3-4615-8334-4e1bc3102f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Flow 'volume_create_manager' (eff12dbb-0b71-4d59-b44c-8ab5ca602a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:10 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2e730a33-8be0-42d8-952d-36851d780a7e tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Created volume successfully.
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "cinder-4cecfa73-1339-4cf9-88c9-b1917120d640-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-4cecfa73-1339-4cf9-88c9-b1917120d640-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "cinder-quobyte-4cecfa73-1339-4cf9-88c9-b1917120d640" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-quobyte-4cecfa73-1339-4cf9-88c9-b1917120d640" acquired by "delete_volume" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9165c26-64f8-4db8-9744-961eae35e0e8]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4cecfa73-1339-4cf9-88c9-b1917120d640 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:10 devstack sudo[104377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4cecfa73-1339-4cf9-88c9-b1917120d640
Sep 16 08:55:10 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:10 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-26616991-6c6e-4619-bc0b-491e2da627d5 1073741824" returned: 0 in 0.449s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-26616991-6c6e-4619-bc0b-491e2da627d5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:11 devstack sudo[104379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-26616991-6c6e-4619-bc0b-491e2da627d5
Sep 16 08:55:11 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:11 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4cecfa73-1339-4cf9-88c9-b1917120d640" returned: 0 in 0.393s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4cecfa73-1339-4cf9-88c9-b1917120d640 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:11 devstack sudo[104384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4cecfa73-1339-4cf9-88c9-b1917120d640
Sep 16 08:55:11 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:11 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-26616991-6c6e-4619-bc0b-491e2da627d5" returned: 0 in 0.264s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.843s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f58d1a8-0921-44be-9595-3f2b4377ad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26616991-6c6e-4619-bc0b-491e2da627d5', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93dcfe3-d1aa-4b82-b8b1-65cf1f29a0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] Creating offline snapshot 26e3a825-27b4-425d-bcd5-e4fdcc4a47ee of volume 52d8f806-e9d3-4c7f-abcf-a1ce9608bacd {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:55:11 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume volume-26616991-6c6e-4619-bc0b-491e2da627d5 (26616991-6c6e-4619-bc0b-491e2da627d5): created successfully
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93dcfe3-d1aa-4b82-b8b1-65cf1f29a0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Flow 'volume_create_manager' (6260df53-74e1-475f-98dc-6c9c19125796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e27b98-c446-465d-82a2-a05c115bb1c0]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:11 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b4467673-42bf-4f94-b1ff-a7d237a32633 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Created volume successfully.
Sep 16 08:55:11 devstack sudo[104387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd
Sep 16 08:55:11 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:11 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4cecfa73-1339-4cf9-88c9-b1917120d640" returned: 0 in 0.295s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-quobyte-4cecfa73-1339-4cf9-88c9-b1917120d640" released by "delete_volume" :: held 0.733s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Created reservations ['d307c280-5a01-4bb2-906e-bc4ec84a11b8', '3c948ddb-2229-4841-a772-b36a382bca00', 'a740d94e-8ad9-49e7-ade6-194162807deb', 'f1ddbda2-a8a8-449e-b60c-648479f930ae'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:11 devstack sudo[104390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:11 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:11 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd" returned: 0 in 0.435s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:11 devstack sudo[104396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee 1G
Sep 16 08:55:11 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "cinder-df163250-6219-4a42-b32d-6ab9b66d6aef-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-df163250-6219-4a42-b32d-6ab9b66d6aef-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:11 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.284s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:11 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Deleted volume successfully.
Sep 16 08:55:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b4d565e2-f553-49ab-81f7-4766715b0081 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-4cecfa73-1339-4cf9-88c9-b1917120d640-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "cinder-quobyte-df163250-6219-4a42-b32d-6ab9b66d6aef" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-quobyte-df163250-6219-4a42-b32d-6ab9b66d6aef" acquired by "delete_volume" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1df2d03-cc0a-4b3a-928d-0cc8fc8bd196]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-df163250-6219-4a42-b32d-6ab9b66d6aef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:12 devstack sudo[104400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-df163250-6219-4a42-b32d-6ab9b66d6aef
Sep 16 08:55:12 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:12 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee 1G" returned: 0 in 0.447s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:12 devstack sudo[104405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee
Sep 16 08:55:12 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:12 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-df163250-6219-4a42-b32d-6ab9b66d6aef" returned: 0 in 0.394s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-df163250-6219-4a42-b32d-6ab9b66d6aef {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:12 devstack sudo[104410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-df163250-6219-4a42-b32d-6ab9b66d6aef
Sep 16 08:55:12 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:12 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee" returned: 0 in 0.350s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:12 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee is being set with open permissions: ugo+rw
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:12 devstack sudo[104416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee
Sep 16 08:55:12 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:12 devstack sudo[104418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:12 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:12 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-df163250-6219-4a42-b32d-6ab9b66d6aef" returned: 0 in 0.300s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-quobyte-df163250-6219-4a42-b32d-6ab9b66d6aef" released by "delete_volume" :: held 0.748s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Created reservations ['b86ddbc0-8e23-4ecd-bbb6-30b3e34f9536', 'fd76c8c6-bb21-4e65-a1fc-5f95344cf093', '1c1a8454-a6d6-4650-be1a-ed1c81ec1174', '864eae25-ffb8-4677-872d-d7aad4c77ca1'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:12 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee" returned: 0 in 0.281s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:12 devstack sudo[104423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:12 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:12 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.304s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:55:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:55:12 devstack sudo[104425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.info
Sep 16 08:55:12 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "cinder-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "cinder-quobyte-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:13 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.279s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-quobyte-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:13 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Deleted volume successfully.
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fdc1d1-7987-4fa7-a05a-c16eec5c4f80]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3960ef1f-2a22-49c6-a761-238fad3f68a1 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-df163250-6219-4a42-b32d-6ab9b66d6aef-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:13 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.info" returned: 0 in 0.300s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:13 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.info is being set with open permissions: ugo+rw
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:13 devstack sudo[104430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.info
Sep 16 08:55:13 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:13 devstack sudo[104429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2
Sep 16 08:55:13 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:13 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.info" returned: 0 in 0.251s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.904s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1136441153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1105850b-bf5c-4a4c-9344-d249e26d9f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa67a6b0bc4453c9648c4c9ecb730c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:06Z,use_quota=True,user_id='c5c9d2831cc44bdd820614ecad39a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Creating volume 1105850b-bf5c-4a4c-9344-d249e26d9f55 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:13 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1105850b-bf5c-4a4c-9344-d249e26d9f55 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:13 devstack sudo[104436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1105850b-bf5c-4a4c-9344-d249e26d9f55 1073741824
Sep 16 08:55:13 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:13 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3f8c2334-0d1f-45b8-83c4-964af4989560 tempest-CreateVolumesFromSnapshotTest-286226697 None] Create snapshot completed successfully
Sep 16 08:55:13 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2" returned: 0 in 0.414s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:13 devstack sudo[104439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2
Sep 16 08:55:13 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:13 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2" returned: 0 in 0.335s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-quobyte-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2" released by "delete_volume" :: held 0.805s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Created reservations ['8d78e3f7-00b2-4111-866a-33240b7cbe71', '2831d1de-55ae-4f8b-8ab3-962ff854439b', '73ff87e3-2314-4664-8ba8-92700b0e9056', '54274857-d406-49c7-9dbb-74a74280f683'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:14 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1105850b-bf5c-4a4c-9344-d249e26d9f55 1073741824" returned: 0 in 0.539s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1105850b-bf5c-4a4c-9344-d249e26d9f55 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:14 devstack sudo[104446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1105850b-bf5c-4a4c-9344-d249e26d9f55
Sep 16 08:55:14 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:14 devstack sudo[104448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:14 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Flow 'volume_create_manager' (007f92ed-c1a3-436f-9a43-42b866baebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4995c0d7-4355-4771-bf31-e58fb8bc8097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "cinder-5d4d8f03-e319-409a-a810-9c564dcdf390-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4995c0d7-4355-4771-bf31-e58fb8bc8097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-39683945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c87a50-b480-49f3-becc-9df70f70aa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94932a32cb4f1fa4558d70bb6ec6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:14Z,use_quota=True,user_id='d42a00abdaa34c4584b77bb4012117b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c2018d-cee0-4e00-a309-5ea1a1330797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c2018d-cee0-4e00-a309-5ea1a1330797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ea23d6-94ce-4406-848e-1555bd31a203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ea23d6-94ce-4406-848e-1555bd31a203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c87a50-b480-49f3-becc-9df70f70aa52', 'volume_name': 'volume-d5c87a50-b480-49f3-becc-9df70f70aa52', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4997ce58-23b6-402e-ba97-7e94ccb4db37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4997ce58-23b6-402e-ba97-7e94ccb4db37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1ad810-38da-4ad9-b405-8cb1ce29547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:14 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume d5c87a50-b480-49f3-becc-9df70f70aa52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c87a50-b480-49f3-becc-9df70f70aa52', 'volume_size': 1}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-5d4d8f03-e319-409a-a810-9c564dcdf390-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:14 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1105850b-bf5c-4a4c-9344-d249e26d9f55" returned: 0 in 0.369s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.447s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022305827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51fa6924-1ff6-4209-ab1d-dd75dedd1555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa67a6b0bc4453c9648c4c9ecb730c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:07Z,use_quota=True,user_id='c5c9d2831cc44bdd820614ecad39a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Creating volume 51fa6924-1ff6-4209-ab1d-dd75dedd1555 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:14 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "cinder-quobyte-5d4d8f03-e319-409a-a810-9c564dcdf390" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:14 devstack sudo[104451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555 1073741824
Sep 16 08:55:14 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5e1429-c562-4a86-9063-c69c767cb3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1105850b-bf5c-4a4c-9344-d249e26d9f55', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99816a06-d625-4d23-91f5-2e47823a4ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-quobyte-5d4d8f03-e319-409a-a810-9c564dcdf390" acquired by "delete_volume" :: waited 0.044s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:14 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:14 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume volume-1105850b-bf5c-4a4c-9344-d249e26d9f55 (1105850b-bf5c-4a4c-9344-d249e26d9f55): created successfully
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99816a06-d625-4d23-91f5-2e47823a4ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Flow 'volume_create_manager' (92421351-10aa-47d5-b85e-bfb3d5560900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[89681ee1-90f0-4d9b-9e7a-6804ec7f539d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5d4d8f03-e319-409a-a810-9c564dcdf390 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.515s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:14 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-12fc15a6-41fb-4df2-9f36-c8f3eb7e4dbe tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Created volume successfully.
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:14 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Deleted volume successfully.
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-994c354a-3ec9-42d3-bbaf-0036cc0442ac tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-d62a431b-e5ef-46e4-8df7-350dd0e6fdf2-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Flow 'volume_create_manager' (950418a5-7696-407b-b75b-9d1507c22b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036c7f05-9981-44a0-8889-121c1567d97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:14 devstack sudo[104454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5d4d8f03-e319-409a-a810-9c564dcdf390
Sep 16 08:55:14 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036c7f05-9981-44a0-8889-121c1567d97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1393173904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bece938a-8c4a-4519-9e0b-f8f81ce48cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94932a32cb4f1fa4558d70bb6ec6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:15Z,use_quota=True,user_id='d42a00abdaa34c4584b77bb4012117b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110405c6-4f44-403e-b5a5-326e339fcdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110405c6-4f44-403e-b5a5-326e339fcdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04b4935-d441-437a-a018-5d866daaf985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04b4935-d441-437a-a018-5d866daaf985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bece938a-8c4a-4519-9e0b-f8f81ce48cab', 'volume_name': 'volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcc8d96-1c52-45ae-ad3c-b034c285dbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcc8d96-1c52-45ae-ad3c-b034c285dbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1059185c-4b2d-43b3-876f-9d42100bbbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:14 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume bece938a-8c4a-4519-9e0b-f8f81ce48cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab', 'volume_size': 1}
Sep 16 08:55:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Flow 'volume_create_manager' (13da4914-8e6d-4fcc-a5ad-dd4eed4230d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f83819-4a2d-4b68-8106-30cc2a5589c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f83819-4a2d-4b68-8106-30cc2a5589c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1335295655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c410d7-05f8-44e1-b03f-587ea33d1bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94932a32cb4f1fa4558d70bb6ec6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:15Z,use_quota=True,user_id='d42a00abdaa34c4584b77bb4012117b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702798d3-0a5e-4e30-94df-c9b93ec79bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702798d3-0a5e-4e30-94df-c9b93ec79bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c5bec9-2404-4682-b48a-8daee1ff2cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c5bec9-2404-4682-b48a-8daee1ff2cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c410d7-05f8-44e1-b03f-587ea33d1bd5', 'volume_name': 'volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ac941a-0dc7-4e91-ab04-50834fc3ee5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:15 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ac941a-0dc7-4e91-ab04-50834fc3ee5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a52160-601a-43dc-be55-08823660a835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:15 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume b1c410d7-05f8-44e1-b03f-587ea33d1bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5', 'volume_size': 1}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5d4d8f03-e319-409a-a810-9c564dcdf390" returned: 0 in 0.530s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5d4d8f03-e319-409a-a810-9c564dcdf390 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:15 devstack sudo[104463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5d4d8f03-e319-409a-a810-9c564dcdf390
Sep 16 08:55:15 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:15 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555 1073741824" returned: 0 in 0.723s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:15 devstack sudo[104465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555
Sep 16 08:55:15 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:15 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5d4d8f03-e319-409a-a810-9c564dcdf390" returned: 0 in 0.271s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-quobyte-5d4d8f03-e319-409a-a810-9c564dcdf390" released by "delete_volume" :: held 0.889s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Created reservations ['1624cce8-4c56-40d1-ab48-d258892f0646', '707a12d0-ef48-4d6d-921f-b3c8b128d409', '343b1a2c-7669-40db-b322-38ff654881b9', '861a41e7-6772-4888-97ab-5c6d1f3df0e9'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:15 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555" returned: 0 in 0.307s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.096s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1645459540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b51304b-c847-4429-b7d9-4120431cf545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa67a6b0bc4453c9648c4c9ecb730c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:07Z,use_quota=True,user_id='c5c9d2831cc44bdd820614ecad39a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Creating volume 5b51304b-c847-4429-b7d9-4120431cf545 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:15 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5b51304b-c847-4429-b7d9-4120431cf545 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:15 devstack sudo[104469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5b51304b-c847-4429-b7d9-4120431cf545 1073741824
Sep 16 08:55:15 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298dd3a2-8f26-4059-82f9-31eee8f77867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9070523-18f9-4373-97e1-c97593ff2a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Flow 'volume_create_manager' (70de5494-f605-42ca-858e-7ee33af877e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab187a9-e1b1-4fa0-9011-d3dd00115d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:15 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555 (51fa6924-1ff6-4209-ab1d-dd75dedd1555): created successfully
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9070523-18f9-4373-97e1-c97593ff2a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Flow 'volume_create_manager' (d6b28ac2-3f10-4b5f-bf21-3b21664c8963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab187a9-e1b1-4fa0-9011-d3dd00115d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1489270653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8914c271-10f6-4c35-9acd-b275106c0022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94932a32cb4f1fa4558d70bb6ec6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:16Z,use_quota=True,user_id='d42a00abdaa34c4584b77bb4012117b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7afbbe-c721-4de3-a915-b837dba0d5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7afbbe-c721-4de3-a915-b837dba0d5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67410eec-0107-4dab-9a72-dbe96caa32bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67410eec-0107-4dab-9a72-dbe96caa32bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8914c271-10f6-4c35-9acd-b275106c0022', 'volume_name': 'volume-8914c271-10f6-4c35-9acd-b275106c0022', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555bc4cd-17f4-42e4-949f-8371ec8dd9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555bc4cd-17f4-42e4-949f-8371ec8dd9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001b1f50-8a09-427a-bee6-8dd96b212167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:15 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume 8914c271-10f6-4c35-9acd-b275106c0022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8914c271-10f6-4c35-9acd-b275106c0022', 'volume_size': 1}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:15 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d2006123-3ac7-4a30-98b6-232817b3587d tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Created volume successfully.
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:15 devstack sudo[104471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:15 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Flow 'volume_create_manager' (ac9d34cb-0e7b-4e9d-b110-dc0154976093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33b515d-9ecd-46a7-87f8-5d5ddac6d004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33b515d-9ecd-46a7-87f8-5d5ddac6d004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-12358114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e20a10-935d-4b40-884c-efc154de591e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94932a32cb4f1fa4558d70bb6ec6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:16Z,use_quota=True,user_id='d42a00abdaa34c4584b77bb4012117b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d0f2ae-2a84-4caa-8dab-3964b48eebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d0f2ae-2a84-4caa-8dab-3964b48eebe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4827d2eb-5022-4677-bc0a-90784ee87693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4827d2eb-5022-4677-bc0a-90784ee87693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e20a10-935d-4b40-884c-efc154de591e', 'volume_name': 'volume-d5e20a10-935d-4b40-884c-efc154de591e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ff205f-5ee1-42b3-8ca6-f9b4b649b77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ff205f-5ee1-42b3-8ca6-f9b4b649b77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80136fdb-4f42-466f-b21d-25edd1a95119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:16 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume d5e20a10-935d-4b40-884c-efc154de591e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e20a10-935d-4b40-884c-efc154de591e', 'volume_size': 1}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:16 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.300s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:16 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:16 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Deleted volume successfully.
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5b51304b-c847-4429-b7d9-4120431cf545 1073741824" returned: 0 in 0.522s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e8c29595-eee5-4a4f-977a-0fd47c493322 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-5d4d8f03-e319-409a-a810-9c564dcdf390-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5b51304b-c847-4429-b7d9-4120431cf545 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:16 devstack sudo[104478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5b51304b-c847-4429-b7d9-4120431cf545
Sep 16 08:55:16 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:16 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5b51304b-c847-4429-b7d9-4120431cf545" returned: 0 in 0.245s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.883s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9f0b0d-c476-41ba-852c-8519149e08b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2474a73b0e054cdd85e8e9ef7551772a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:08Z,use_quota=True,user_id='9660eb80a3f64001855e5d79b855bb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(165f2889-4246-4a50-b914-e534150c9466),volume_type_id=165f2889-4246-4a50-b914-e534150c9466)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Creating volume 4d9f0b0d-c476-41ba-852c-8519149e08b5 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:16 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3247af54-e5ca-4cc2-b9bc-20e54a5ee7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b51304b-c847-4429-b7d9-4120431cf545', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d3118a-5c05-4cee-8e2a-0dd04521c8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:16 devstack sudo[104481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5 1073741824
Sep 16 08:55:16 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:16 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Volume volume-5b51304b-c847-4429-b7d9-4120431cf545 (5b51304b-c847-4429-b7d9-4120431cf545): created successfully
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d3118a-5c05-4cee-8e2a-0dd04521c8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Flow 'volume_create_manager' (32fd51d1-2705-4122-87e5-6fc8d1043dbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:16 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-faf02358-4c05-442a-87a9-fa71e01b7c09 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Created volume successfully.
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "cinder-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "cinder-quobyte-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-quobyte-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d242912-7bf1-4880-bb5e-fd1f195927cd]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:16 devstack sudo[104485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76
Sep 16 08:55:16 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:16 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5 1073741824" returned: 0 in 0.469s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:16 devstack sudo[104488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5
Sep 16 08:55:16 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:17 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76" returned: 0 in 0.377s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:17 devstack sudo[104493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76
Sep 16 08:55:17 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:17 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5" returned: 0 in 0.271s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.784s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-39683945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c87a50-b480-49f3-becc-9df70f70aa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94932a32cb4f1fa4558d70bb6ec6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:14Z,use_quota=True,user_id='d42a00abdaa34c4584b77bb4012117b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Creating volume d5c87a50-b480-49f3-becc-9df70f70aa52 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:17 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5c87a50-b480-49f3-becc-9df70f70aa52 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:17 devstack sudo[104496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5c87a50-b480-49f3-becc-9df70f70aa52 1073741824
Sep 16 08:55:17 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Attempting download of cf531690-eba1-40cd-99d9-74a0c2a81d57 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf531690-eba1-40cd-99d9-74a0c2a81d57', 'metadata': {}}])) to volume 4d9f0b0d-c476-41ba-852c-8519149e08b5. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 08:55:17 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "cinder-5b51304b-c847-4429-b7d9-4120431cf545-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8ae510-f10d-4977-a792-cfe86d7d61e2]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf531690-eba1-40cd-99d9-74a0c2a81d57_ljx2i1n4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76" returned: 0 in 0.324s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-quobyte-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76" released by "delete_volume" :: held 0.769s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-5b51304b-c847-4429-b7d9-4120431cf545-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "cinder-quobyte-5b51304b-c847-4429-b7d9-4120431cf545" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-quobyte-5b51304b-c847-4429-b7d9-4120431cf545" acquired by "delete_volume" :: waited 0.030s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:17 devstack sudo[104499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf531690-eba1-40cd-99d9-74a0c2a81d57_ljx2i1n4
Sep 16 08:55:17 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Created reservations ['1a5d17d9-b967-4ad3-acaa-4db9984b1d85', '448a9a62-17a3-46a0-8edd-c05160ecd3af', 'f1e1277b-1b23-45ba-aa4b-cc4d62cc7d8a', 'a59d80dc-3d98-4a42-9331-da99a3e79280'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a9d12b-7803-4a02-87d8-e72550eadae5]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5b51304b-c847-4429-b7d9-4120431cf545 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:17 devstack sudo[104504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5b51304b-c847-4429-b7d9-4120431cf545
Sep 16 08:55:17 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:17 devstack sudo[104507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:17 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:17 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5c87a50-b480-49f3-becc-9df70f70aa52 1073741824" returned: 0 in 0.655s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5c87a50-b480-49f3-becc-9df70f70aa52 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:17 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf531690-eba1-40cd-99d9-74a0c2a81d57_ljx2i1n4" returned: 0 in 0.591s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf531690-eba1-40cd-99d9-74a0c2a81d57_ljx2i1n4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:17 devstack sudo[104511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5c87a50-b480-49f3-becc-9df70f70aa52
Sep 16 08:55:17 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:18 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.374s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:18 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Deleted volume successfully.
Sep 16 08:55:18 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5b51304b-c847-4429-b7d9-4120431cf545" returned: 0 in 0.561s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5b51304b-c847-4429-b7d9-4120431cf545 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0a3b0cbc-d805-4ca4-b205-d173e79d66a2 tempest-CreateVolumesFromImageTest-614897086 None] Lock "cinder-5cd3cb96-4e91-4eb6-9e30-d92c08f45b76-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:18 devstack sudo[104515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf531690-eba1-40cd-99d9-74a0c2a81d57_ljx2i1n4
Sep 16 08:55:18 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:18 devstack sudo[104518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5b51304b-c847-4429-b7d9-4120431cf545
Sep 16 08:55:18 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:18 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5c87a50-b480-49f3-becc-9df70f70aa52" returned: 0 in 0.314s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.353s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1393173904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bece938a-8c4a-4519-9e0b-f8f81ce48cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94932a32cb4f1fa4558d70bb6ec6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:15Z,use_quota=True,user_id='d42a00abdaa34c4584b77bb4012117b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Creating volume bece938a-8c4a-4519-9e0b-f8f81ce48cab {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:18 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1ad810-38da-4ad9-b405-8cb1ce29547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c87a50-b480-49f3-becc-9df70f70aa52', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:18 devstack sudo[104522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab 1073741824
Sep 16 08:55:18 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36f3c3f-e955-49ff-bd31-8f00cccaf253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:18 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume volume-d5c87a50-b480-49f3-becc-9df70f70aa52 (d5c87a50-b480-49f3-becc-9df70f70aa52): created successfully
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36f3c3f-e955-49ff-bd31-8f00cccaf253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Flow 'volume_create_manager' (007f92ed-c1a3-436f-9a43-42b866baebe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:18 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-da73147e-4a50-48ed-92b4-d385a264cd13 tempest-CreateVolumesFromSnapshotTest-286226697 None] Created volume successfully.
Sep 16 08:55:18 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf531690-eba1-40cd-99d9-74a0c2a81d57_ljx2i1n4" returned: 1 in 0.505s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf531690-eba1-40cd-99d9-74a0c2a81d57_ljx2i1n4' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0ef354-72a5-4a73-ba2b-dc065e7199c3]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:18 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-5b51304b-c847-4429-b7d9-4120431cf545" returned: 0 in 0.413s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-quobyte-5b51304b-c847-4429-b7d9-4120431cf545" released by "delete_volume" :: held 1.049s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:18 devstack sudo[104527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD
Sep 16 08:55:18 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Created reservations ['d7cbd698-64a9-4e8c-80d8-f18f37f544f2', '6147697f-5183-445c-be1c-774a23173185', 'f8e1f32b-f509-4e58-abc9-b0a9b57c86f0', 'c16b860f-1e2f-4e64-9541-461cea8bc8ba'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:18 devstack sudo[104533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:18 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:18 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab 1073741824" returned: 0 in 0.590s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:18 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD" returned: 0 in 0.418s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:18 devstack sudo[104538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab
Sep 16 08:55:18 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:19 devstack sudo[104537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD
Sep 16 08:55:19 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:19 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.354s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:19 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Deleted volume successfully.
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-80ad5fb4-f089-4bad-a857-5547caf8c34c tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-5b51304b-c847-4429-b7d9-4120431cf545-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:19 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab" returned: 0 in 0.317s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.068s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1335295655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c410d7-05f8-44e1-b03f-587ea33d1bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94932a32cb4f1fa4558d70bb6ec6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:15Z,use_quota=True,user_id='d42a00abdaa34c4584b77bb4012117b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Creating volume b1c410d7-05f8-44e1-b03f-587ea33d1bd5 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:19 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1059185c-4b2d-43b3-876f-9d42100bbbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:19 devstack sudo[104544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5 1073741824
Sep 16 08:55:19 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d31461-4450-4211-add4-d12498001c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:19 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab (bece938a-8c4a-4519-9e0b-f8f81ce48cab): created successfully
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d31461-4450-4211-add4-d12498001c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:19 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Flow 'volume_create_manager' (950418a5-7696-407b-b75b-9d1507c22b64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD" returned: 1 in 0.428s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] cf531690-eba1-40cd-99d9-74a0c2a81d57 was raw, converting to qcow2 {{(pid=86261) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:19 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-afd40781-c658-43c2-91f9-07c75212132c tempest-CreateVolumesFromSnapshotTest-286226697 None] Created volume successfully.
Sep 16 08:55:19 devstack sudo[104548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5
Sep 16 08:55:19 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "cinder-51fa6924-1ff6-4209-ab1d-dd75dedd1555-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-51fa6924-1ff6-4209-ab1d-dd75dedd1555-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "cinder-quobyte-51fa6924-1ff6-4209-ab1d-dd75dedd1555" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-quobyte-51fa6924-1ff6-4209-ab1d-dd75dedd1555" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:19 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5 1073741824" returned: 0 in 0.559s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e68ab3d-f41e-4be1-b0a3-67e5544a4efb]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:19 devstack sudo[104559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5
Sep 16 08:55:19 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:19 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5" returned: 0 in 0.609s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:19 devstack sudo[104558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555
Sep 16 08:55:19 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf531690-eba1-40cd-99d9-74a0c2a81d57_3hs5sol0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:55:19 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 08:55:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:19 devstack sudo[104562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5 1G
Sep 16 08:55:19 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:20 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5" returned: 0 in 0.300s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.396s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1489270653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8914c271-10f6-4c35-9acd-b275106c0022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94932a32cb4f1fa4558d70bb6ec6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:16Z,use_quota=True,user_id='d42a00abdaa34c4584b77bb4012117b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Creating volume 8914c271-10f6-4c35-9acd-b275106c0022 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:20 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8914c271-10f6-4c35-9acd-b275106c0022 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a52160-601a-43dc-be55-08823660a835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fcb44f-26bb-4867-9eab-41e260d72cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:20 devstack sudo[104570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8914c271-10f6-4c35-9acd-b275106c0022 1073741824
Sep 16 08:55:20 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:20 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5 (b1c410d7-05f8-44e1-b03f-587ea33d1bd5): created successfully
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fcb44f-26bb-4867-9eab-41e260d72cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Flow 'volume_create_manager' (13da4914-8e6d-4fcc-a5ad-dd4eed4230d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:20 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a895bcaf-0084-4b4a-9c61-eea9d43a8782 tempest-CreateVolumesFromSnapshotTest-286226697 None] Created volume successfully.
Sep 16 08:55:20 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555" returned: 0 in 0.506s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:20 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5 1G" returned: 0 in 0.406s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Downloaded image cf531690-eba1-40cd-99d9-74a0c2a81d57 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf531690-eba1-40cd-99d9-74a0c2a81d57', 'metadata': {}}])) to volume 4d9f0b0d-c476-41ba-852c-8519149e08b5 successfully. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Temporary image cf531690-eba1-40cd-99d9-74a0c2a81d57 for user 9660eb80a3f64001855e5d79b855bb76 is deleted. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Marking volume 4d9f0b0d-c476-41ba-852c-8519149e08b5 as bootable. {{(pid=86261) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 08:55:20 devstack sudo[104575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555
Sep 16 08:55:20 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Copying metadata from image cf531690-eba1-40cd-99d9-74a0c2a81d57 to 4d9f0b0d-c476-41ba-852c-8519149e08b5. {{(pid=86261) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Creating volume glance metadata for volume 4d9f0b0d-c476-41ba-852c-8519149e08b5 backed by image cf531690-eba1-40cd-99d9-74a0c2a81d57 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cf531690-eba1-40cd-99d9-74a0c2a81d57', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0b93c03e582a15d0a0057633897e2101', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86261) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4111d903-4c5a-471b-bcc2-fa1b655415c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9f0b0d-c476-41ba-852c-8519149e08b5', 'volume_size': 1, 'image_id': 'cf531690-eba1-40cd-99d9-74a0c2a81d57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf531690-eba1-40cd-99d9-74a0c2a81d57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b93c03e582a15d0a0057633897e2101', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2474a73b0e054cdd85e8e9ef7551772a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '02387f911a36e68f493df53055fc7976ec799a68180da03fc2d0c1868ac4f794d88d9d5166460890612f3f055d290605ecf590b02f6b726a26a8eea45201b9ca', 'id': 'cf531690-eba1-40cd-99d9-74a0c2a81d57', 'created_at': datetime.datetime(2026, 9, 16, 6, 55, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 55, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf531690-eba1-40cd-99d9-74a0c2a81d57/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0ef14aab0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67946d4-9ad1-4906-b212-7c4ec5303020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:20 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Volume volume-4d9f0b0d-c476-41ba-852c-8519149e08b5 (4d9f0b0d-c476-41ba-852c-8519149e08b5): created successfully
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67946d4-9ad1-4906-b212-7c4ec5303020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Flow 'volume_create_manager' (e7be3710-b641-44f8-af3f-d33c57e423a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:20 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5875e327-bb3a-43b1-9555-f2208ba628cb tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Created volume successfully.
Sep 16 08:55:20 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-51fa6924-1ff6-4209-ab1d-dd75dedd1555" returned: 0 in 0.306s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-quobyte-51fa6924-1ff6-4209-ab1d-dd75dedd1555" released by "delete_volume" :: held 0.859s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Created reservations ['7b23fadc-4d24-4bac-824e-755bf6fc5c83', '4ccc0bc8-a991-4f3a-969b-48d141f76178', 'fcf7ac76-4f9c-49b3-86f7-d8d8294536e2', '37e5a503-fd14-46d2-a8a5-4ebf49742b55'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:20 devstack sudo[104582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:20 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:20 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8914c271-10f6-4c35-9acd-b275106c0022 1073741824" returned: 0 in 0.680s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "cinder-1105850b-bf5c-4a4c-9344-d249e26d9f55-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-1105850b-bf5c-4a4c-9344-d249e26d9f55-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8914c271-10f6-4c35-9acd-b275106c0022 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:20 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "cinder-quobyte-1105850b-bf5c-4a4c-9344-d249e26d9f55" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-quobyte-1105850b-bf5c-4a4c-9344-d249e26d9f55" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:21 devstack sudo[104584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8914c271-10f6-4c35-9acd-b275106c0022
Sep 16 08:55:21 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c716d7-c409-45a0-8588-a3c817fae3ec]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1105850b-bf5c-4a4c-9344-d249e26d9f55 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:21 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.316s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:21 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Deleted volume successfully.
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d4961316-d872-4458-b4c8-44aeef619c70 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-51fa6924-1ff6-4209-ab1d-dd75dedd1555-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:21 devstack sudo[104586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1105850b-bf5c-4a4c-9344-d249e26d9f55
Sep 16 08:55:21 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:21 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8914c271-10f6-4c35-9acd-b275106c0022" returned: 0 in 0.328s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.183s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-12358114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e20a10-935d-4b40-884c-efc154de591e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c94932a32cb4f1fa4558d70bb6ec6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:16Z,use_quota=True,user_id='d42a00abdaa34c4584b77bb4012117b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Creating volume d5e20a10-935d-4b40-884c-efc154de591e {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:21 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5e20a10-935d-4b40-884c-efc154de591e 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001b1f50-8a09-427a-bee6-8dd96b212167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8914c271-10f6-4c35-9acd-b275106c0022', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:21 devstack sudo[104590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5e20a10-935d-4b40-884c-efc154de591e 1073741824
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fae7a8-e420-485a-b030-3e9acff18251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:21 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:21 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume volume-8914c271-10f6-4c35-9acd-b275106c0022 (8914c271-10f6-4c35-9acd-b275106c0022): created successfully
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fae7a8-e420-485a-b030-3e9acff18251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Flow 'volume_create_manager' (70de5494-f605-42ca-858e-7ee33af877e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:21 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-396a6a68-bf5a-4e43-ba55-7b5a53b76726 tempest-CreateVolumesFromSnapshotTest-286226697 None] Created volume successfully.
Sep 16 08:55:21 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1105850b-bf5c-4a4c-9344-d249e26d9f55" returned: 0 in 0.417s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1105850b-bf5c-4a4c-9344-d249e26d9f55 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:21 devstack sudo[104595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1105850b-bf5c-4a4c-9344-d249e26d9f55
Sep 16 08:55:21 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Acquiring lock "cinder-4d9f0b0d-c476-41ba-852c-8519149e08b5-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Lock "cinder-4d9f0b0d-c476-41ba-852c-8519149e08b5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Acquiring lock "cinder-quobyte-4d9f0b0d-c476-41ba-852c-8519149e08b5" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Lock "cinder-quobyte-4d9f0b0d-c476-41ba-852c-8519149e08b5" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b3411e-60d3-4e2f-9a7c-5066a53e11af]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:21 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1105850b-bf5c-4a4c-9344-d249e26d9f55" returned: 0 in 0.397s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:21 devstack sudo[104600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5
Sep 16 08:55:21 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:21 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5e20a10-935d-4b40-884c-efc154de591e 1073741824" returned: 0 in 0.596s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-quobyte-1105850b-bf5c-4a4c-9344-d249e26d9f55" released by "delete_volume" :: held 0.888s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5e20a10-935d-4b40-884c-efc154de591e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:21 devstack sudo[104605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5e20a10-935d-4b40-884c-efc154de591e
Sep 16 08:55:21 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:21 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Created reservations ['b77a03a7-5fd1-44e3-859f-dd3ad49098b1', '0d9d6f39-7c34-4de6-aa3a-777fa15306e9', '1990f471-716d-4c8a-ae1c-f1379e6fbbc3', 'f9b4dda3-0644-49fe-8a5b-9e410e9bfdb9'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:22 devstack sudo[104607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:22 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "cinder-26616991-6c6e-4619-bc0b-491e2da627d5-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-26616991-6c6e-4619-bc0b-491e2da627d5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:22 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5" returned: 0 in 0.558s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "cinder-quobyte-26616991-6c6e-4619-bc0b-491e2da627d5" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:22 devstack sudo[104614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5
Sep 16 08:55:22 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-quobyte-26616991-6c6e-4619-bc0b-491e2da627d5" acquired by "delete_volume" :: waited 0.036s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:22 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5e20a10-935d-4b40-884c-efc154de591e" returned: 0 in 0.433s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80136fdb-4f42-466f-b21d-25edd1a95119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e20a10-935d-4b40-884c-efc154de591e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1b2cda-9d5f-46d6-a2ff-9bb53fbd6ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2f6ea3-b645-4af1-98ce-c16f3544c1d6]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-26616991-6c6e-4619-bc0b-491e2da627d5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:22 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Volume volume-d5e20a10-935d-4b40-884c-efc154de591e (d5e20a10-935d-4b40-884c-efc154de591e): created successfully
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1b2cda-9d5f-46d6-a2ff-9bb53fbd6ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Flow 'volume_create_manager' (ac9d34cb-0e7b-4e9d-b110-dc0154976093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:22 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-22b75c8c-6392-4b51-af8c-c8ae1d258a7a tempest-CreateVolumesFromSnapshotTest-286226697 None] Created volume successfully.
Sep 16 08:55:22 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.379s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:22 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Deleted volume successfully.
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-8f71751c-00d3-4955-87e8-e69f81687d6a tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-1105850b-bf5c-4a4c-9344-d249e26d9f55-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:22 devstack sudo[104616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-26616991-6c6e-4619-bc0b-491e2da627d5
Sep 16 08:55:22 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:22 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-4d9f0b0d-c476-41ba-852c-8519149e08b5" returned: 0 in 0.326s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Lock "cinder-quobyte-4d9f0b0d-c476-41ba-852c-8519149e08b5" released by "delete_volume" :: held 0.933s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Created reservations ['e6792fcf-8d83-48d7-b961-75d45d5974c8', '333412dc-e15c-488b-adec-565ff009a792', '256d27fe-e92c-454b-ae87-3328e0d9d72c', 'bde56b89-4c66-46d0-9016-26437c81b1ea'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:22 devstack sudo[104624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:22 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:22 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-26616991-6c6e-4619-bc0b-491e2da627d5" returned: 0 in 0.492s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-26616991-6c6e-4619-bc0b-491e2da627d5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:22 devstack sudo[104626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-26616991-6c6e-4619-bc0b-491e2da627d5
Sep 16 08:55:22 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-d5e20a10-935d-4b40-884c-efc154de591e-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-d5e20a10-935d-4b40-884c-efc154de591e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-quobyte-d5e20a10-935d-4b40-884c-efc154de591e" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-d5e20a10-935d-4b40-884c-efc154de591e" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a1c3da-ed8c-4e6f-8af5-f2dc818aeb0b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5e20a10-935d-4b40-884c-efc154de591e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:23 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.347s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:23 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:23 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Deleted volume successfully.
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-26616991-6c6e-4619-bc0b-491e2da627d5" returned: 0 in 0.322s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:23 devstack sudo[104628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5e20a10-935d-4b40-884c-efc154de591e
Sep 16 08:55:23 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-quobyte-26616991-6c6e-4619-bc0b-491e2da627d5" released by "delete_volume" :: held 0.882s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-67961e69-caae-4d66-9de9-46dff1a6ab4e tempest-VolumeAndVolumeTypeFromImageTest-688310050 None] Lock "cinder-4d9f0b0d-c476-41ba-852c-8519149e08b5-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Created reservations ['0ec202d6-1285-443e-84df-4c10e8ebefff', 'b0875ac2-2bc4-4a18-bd07-68191b37964a', '266116db-147e-4423-9d60-5242f004214a', '83831e16-8829-4ab7-8c67-29e9af09115f'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:23 devstack sudo[104632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:23 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:23 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5e20a10-935d-4b40-884c-efc154de591e" returned: 0 in 0.419s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5e20a10-935d-4b40-884c-efc154de591e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:23 devstack sudo[104637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5e20a10-935d-4b40-884c-efc154de591e
Sep 16 08:55:23 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:23 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.285s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:23 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Deleted volume successfully.
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-672a54bc-1699-463f-9b46-38576f3511cf tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-26616991-6c6e-4619-bc0b-491e2da627d5-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:23 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5e20a10-935d-4b40-884c-efc154de591e" returned: 0 in 0.311s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-d5e20a10-935d-4b40-884c-efc154de591e" released by "delete_volume" :: held 0.791s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Created reservations ['a6bd798f-cf55-4569-8c7a-f424fabe5393', '03beb1a6-e545-499c-96ef-9cd1c241cffa', '2f9f7ccc-f3d1-4b75-9ddc-439d66d3356f', '2b1e1446-d585-42b5-b931-d7eb5508fa53'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:24 devstack sudo[104727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:24 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-8914c271-10f6-4c35-9acd-b275106c0022-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-8914c271-10f6-4c35-9acd-b275106c0022-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-quobyte-8914c271-10f6-4c35-9acd-b275106c0022" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-8914c271-10f6-4c35-9acd-b275106c0022" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:24 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.307s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a13340-c4aa-4edf-8d4a-f11576e267de]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8914c271-10f6-4c35-9acd-b275106c0022 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:24 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Deleted volume successfully.
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-3082e47b-a290-4477-bce0-d5fab27324c7 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-d5e20a10-935d-4b40-884c-efc154de591e-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:24 devstack sudo[104730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8914c271-10f6-4c35-9acd-b275106c0022
Sep 16 08:55:24 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "cinder-390a4ece-7bd3-4642-87c0-1443593f3cce-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-390a4ece-7bd3-4642-87c0-1443593f3cce-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "cinder-quobyte-390a4ece-7bd3-4642-87c0-1443593f3cce" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-quobyte-390a4ece-7bd3-4642-87c0-1443593f3cce" acquired by "delete_volume" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8672ff-94e7-4ced-a724-ddb410b9e1c7]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-390a4ece-7bd3-4642-87c0-1443593f3cce {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:24 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8914c271-10f6-4c35-9acd-b275106c0022" returned: 0 in 0.486s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8914c271-10f6-4c35-9acd-b275106c0022 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:24 devstack sudo[104734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-390a4ece-7bd3-4642-87c0-1443593f3cce
Sep 16 08:55:24 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:24 devstack sudo[104736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8914c271-10f6-4c35-9acd-b275106c0022
Sep 16 08:55:24 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:25 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-390a4ece-7bd3-4642-87c0-1443593f3cce" returned: 0 in 0.420s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-390a4ece-7bd3-4642-87c0-1443593f3cce {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:25 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-8914c271-10f6-4c35-9acd-b275106c0022" returned: 0 in 0.327s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:25 devstack sudo[104743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-390a4ece-7bd3-4642-87c0-1443593f3cce
Sep 16 08:55:25 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-8914c271-10f6-4c35-9acd-b275106c0022" released by "delete_volume" :: held 0.894s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Created reservations ['180d0dc3-a90f-4bcd-9f15-589b7aa57586', '0e6d2094-1987-4a9d-b194-22cd3a5fb1e5', 'b591b21b-0711-4e88-90ff-cec02ffdb15a', '7f66055f-ea49-4c96-9c46-9968b1506313'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:25 devstack sudo[104745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:25 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:25 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-390a4ece-7bd3-4642-87c0-1443593f3cce" returned: 0 in 0.404s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-quobyte-390a4ece-7bd3-4642-87c0-1443593f3cce" released by "delete_volume" :: held 0.897s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Created reservations ['21f38a86-14a6-4692-8841-6334e2557c70', 'da4241ee-0ff1-4a1e-aacb-2686d98a6c85', 'c277a320-b31e-4d41-ad32-f280b67f2364', '9261f331-5906-4c85-90f4-631bf2cbcf27'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:25 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.397s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:25 devstack sudo[104749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:25 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:25 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Deleted volume successfully.
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "cinder-69516fec-60f4-4440-9309-214932d2ac21-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-69516fec-60f4-4440-9309-214932d2ac21-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6eed3138-453a-45b3-9ce6-fdc00b23a432 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-8914c271-10f6-4c35-9acd-b275106c0022-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "cinder-quobyte-69516fec-60f4-4440-9309-214932d2ac21" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-quobyte-69516fec-60f4-4440-9309-214932d2ac21" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f868c35f-4118-4369-90a2-8862b56038e9]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-69516fec-60f4-4440-9309-214932d2ac21 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:26 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.340s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:26 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Deleted volume successfully.
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-bf2477c0-8d0a-4f74-8d62-e94461e4c8cb tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-390a4ece-7bd3-4642-87c0-1443593f3cce-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:26 devstack sudo[104751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-69516fec-60f4-4440-9309-214932d2ac21
Sep 16 08:55:26 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:26 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-69516fec-60f4-4440-9309-214932d2ac21" returned: 0 in 0.494s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-69516fec-60f4-4440-9309-214932d2ac21 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-b1c410d7-05f8-44e1-b03f-587ea33d1bd5-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:26 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-69516fec-60f4-4440-9309-214932d2ac21
Sep 16 08:55:26 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-b1c410d7-05f8-44e1-b03f-587ea33d1bd5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-quobyte-b1c410d7-05f8-44e1-b03f-587ea33d1bd5" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-b1c410d7-05f8-44e1-b03f-587ea33d1bd5" acquired by "delete_volume" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[973f51f3-3b1c-44b3-b42f-3a395c4a2a47]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:26 devstack sudo[104759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5
Sep 16 08:55:26 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:26 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-69516fec-60f4-4440-9309-214932d2ac21" returned: 0 in 0.400s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-quobyte-69516fec-60f4-4440-9309-214932d2ac21" released by "delete_volume" :: held 0.951s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:26 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Created reservations ['db4ad658-9d58-4d46-8ee9-dedaafa058d2', '41d77a37-318a-43a7-b392-ed5505a92dd4', 'f9518d61-a739-4f12-b28f-32d3864b5705', 'cbf3b933-192c-4120-b345-ab7b1942fa39'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:27 devstack sudo[104764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:27 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:27 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5" returned: 0 in 0.498s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:27 devstack sudo[104767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5
Sep 16 08:55:27 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:27 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.391s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Deleted volume successfully.
Sep 16 08:55:27 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b1c410d7-05f8-44e1-b03f-587ea33d1bd5" returned: 0 in 0.311s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-b1c410d7-05f8-44e1-b03f-587ea33d1bd5" released by "delete_volume" :: held 0.888s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f198157-2910-40e8-b97b-cfc31204d0d5 tempest-CreateVolumesFromSourceVolumeTest-956996172 None] Lock "cinder-69516fec-60f4-4440-9309-214932d2ac21-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Created reservations ['e2dc598d-2a77-4b2c-9015-e50801210cb4', '8cb71362-dce9-449c-abfe-64c231456155', 'd6b8583e-49e9-444d-8d56-35555bdbcf14', '6b6fd5bc-82de-4405-9499-f20e9bfab74e'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:27 devstack sudo[104771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:27 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:28 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.275s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:28 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:28 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Deleted volume successfully.
Sep 16 08:55:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-45fe618d-7684-4c18-8b94-ac08102a220a tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-b1c410d7-05f8-44e1-b03f-587ea33d1bd5-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-bece938a-8c4a-4519-9e0b-f8f81ce48cab-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-bece938a-8c4a-4519-9e0b-f8f81ce48cab-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-quobyte-bece938a-8c4a-4519-9e0b-f8f81ce48cab" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-bece938a-8c4a-4519-9e0b-f8f81ce48cab" acquired by "delete_volume" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ca4a1d-366f-49dd-bd3f-408d3175521c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:29 devstack sudo[104774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab
Sep 16 08:55:29 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (d5ac8398-f02d-4ac2-821e-f43850052b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f8ca09-4e31-43f1-8ab0-ffac5bceff89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f8ca09-4e31-43f1-8ab0-ffac5bceff89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746756891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b706028c-dd34-40d8-a9e6-fafa381ce088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:29Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89b4c60-d290-442e-95dc-c6213a07bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89b4c60-d290-442e-95dc-c6213a07bde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e853c0-77d7-4f04-b714-e2cfcd30fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e853c0-77d7-4f04-b714-e2cfcd30fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b706028c-dd34-40d8-a9e6-fafa381ce088', 'volume_name': 'volume-b706028c-dd34-40d8-a9e6-fafa381ce088', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f1ebc1-febe-4f46-bc78-646aaec3956b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f1ebc1-febe-4f46-bc78-646aaec3956b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b995367-f13e-4dc5-b2ec-c33d21f75f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:29 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Volume b706028c-dd34-40d8-a9e6-fafa381ce088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b706028c-dd34-40d8-a9e6-fafa381ce088', 'volume_size': 1}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746756891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b706028c-dd34-40d8-a9e6-fafa381ce088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:29Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Creating volume b706028c-dd34-40d8-a9e6-fafa381ce088 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:29 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:29 devstack sudo[104776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088 1073741824
Sep 16 08:55:29 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:29 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab" returned: 0 in 0.443s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:29 devstack sudo[104781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab
Sep 16 08:55:29 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:29 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-bece938a-8c4a-4519-9e0b-f8f81ce48cab" returned: 0 in 0.333s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-bece938a-8c4a-4519-9e0b-f8f81ce48cab" released by "delete_volume" :: held 0.853s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Created reservations ['4e52172f-40e6-4766-add4-35d11f3f45a7', '6fa8ca15-b51b-49d3-938d-739c8ce5ed34', '08365043-6b4d-4a4b-83e8-86b94f9fefc1', '6efec9ad-addd-49eb-a8f4-527a371db444'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:29 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088 1073741824" returned: 0 in 0.623s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:30 devstack sudo[104788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:30 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:30 devstack sudo[104790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088
Sep 16 08:55:30 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Flow 'volume_create_manager' (aec8c5e5-56a6-4869-a7a9-8107988718ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48a627d-fa7f-42eb-a96b-4d4261d6a7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-d5c87a50-b480-49f3-becc-9df70f70aa52-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48a627d-fa7f-42eb-a96b-4d4261d6a7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-734994894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b7cbb3-91d7-4198-994c-6057bd77610b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf4ba11cb8f4fbbb5b1713400cccb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:30Z,use_quota=True,user_id='c5b5602d4d924a84916e7d14b7f2bb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6377875d-eafa-4a8a-8054-73d915324561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6377875d-eafa-4a8a-8054-73d915324561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ee979e-5961-4eb4-86cd-359d5ff1c61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ee979e-5961-4eb4-86cd-359d5ff1c61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b7cbb3-91d7-4198-994c-6057bd77610b', 'volume_name': 'volume-f9b7cbb3-91d7-4198-994c-6057bd77610b', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871dcb17-559e-4780-8fc6-d534d2f5443a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (871dcb17-559e-4780-8fc6-d534d2f5443a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa442cb-19fa-4c53-9c31-10fce846a4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:30 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Volume f9b7cbb3-91d7-4198-994c-6057bd77610b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b7cbb3-91d7-4198-994c-6057bd77610b', 'volume_size': 1}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-d5c87a50-b480-49f3-becc-9df70f70aa52-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-quobyte-d5c87a50-b480-49f3-becc-9df70f70aa52" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-d5c87a50-b480-49f3-becc-9df70f70aa52" acquired by "delete_volume" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acb6926-f568-41de-8fbc-91aac77f7d17]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5c87a50-b480-49f3-becc-9df70f70aa52 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:30 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:30 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.396s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088" returned: 0 in 0.372s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.172s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-734994894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b7cbb3-91d7-4198-994c-6057bd77610b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf4ba11cb8f4fbbb5b1713400cccb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:30Z,use_quota=True,user_id='c5b5602d4d924a84916e7d14b7f2bb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Creating volume f9b7cbb3-91d7-4198-994c-6057bd77610b {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:30 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Deleted volume successfully.
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b995367-f13e-4dc5-b2ec-c33d21f75f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b706028c-dd34-40d8-a9e6-fafa381ce088', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:30 devstack sudo[104795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b 1073741824
Sep 16 08:55:30 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efab3979-f257-407a-b8b3-f1126740466b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:30 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5c87a50-b480-49f3-becc-9df70f70aa52
Sep 16 08:55:30 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1eecb827-3fda-40f9-9a95-17b6d9e19489 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-bece938a-8c4a-4519-9e0b-f8f81ce48cab-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:30 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Volume volume-b706028c-dd34-40d8-a9e6-fafa381ce088 (b706028c-dd34-40d8-a9e6-fafa381ce088): created successfully
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efab3979-f257-407a-b8b3-f1126740466b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (d5ac8398-f02d-4ac2-821e-f43850052b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7cda5fda-281f-4b8b-8c57-9ca8af91dbad tempest-ProjectMemberTests-1200760860 None] Created volume successfully.
Sep 16 08:55:30 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5c87a50-b480-49f3-becc-9df70f70aa52" returned: 0 in 0.445s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5c87a50-b480-49f3-becc-9df70f70aa52 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:30 devstack sudo[104804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5c87a50-b480-49f3-becc-9df70f70aa52
Sep 16 08:55:30 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:31 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:31 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d5c87a50-b480-49f3-becc-9df70f70aa52" returned: 0 in 0.320s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b 1073741824" returned: 0 in 0.682s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-d5c87a50-b480-49f3-becc-9df70f70aa52" released by "delete_volume" :: held 0.830s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:31 devstack sudo[104808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b
Sep 16 08:55:31 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Created reservations ['924c4740-bfec-4f72-a1e4-2a3ef9fbb27b', 'f4e2d9d9-1ad1-4fd3-aed6-e55266c6cb5e', '086e3d1a-0b85-49d4-a61c-ae4c8039f160', '5630087b-070f-4031-9bfa-5654a23b0289'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:31 devstack sudo[104810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:31 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:31 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b" returned: 0 in 0.293s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa442cb-19fa-4c53-9c31-10fce846a4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b7cbb3-91d7-4198-994c-6057bd77610b', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5710a1a8-7ce5-4fc3-a3ff-4f7f93bb23ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:31 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Volume volume-f9b7cbb3-91d7-4198-994c-6057bd77610b (f9b7cbb3-91d7-4198-994c-6057bd77610b): created successfully
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5710a1a8-7ce5-4fc3-a3ff-4f7f93bb23ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Flow 'volume_create_manager' (aec8c5e5-56a6-4869-a7a9-8107988718ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:31 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-25e00093-bb3b-42e3-92dd-117fa185795c tempest-VolumeDependencyTests-1552316758 None] Created volume successfully.
Sep 16 08:55:31 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.324s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:31 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Deleted volume successfully.
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-366e8142-abbb-41cb-a70c-2ed990a49670 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-d5c87a50-b480-49f3-becc-9df70f70aa52-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-26e3a825-27b4-425d-bcd5-e4fdcc4a47ee-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-26e3a825-27b4-425d-bcd5-e4fdcc4a47ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-quobyte-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-quobyte-26e3a825-27b4-425d-bcd5-e4fdcc4a47ee" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-26e3a825-27b4-425d-bcd5-e4fdcc4a47ee" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Deleting offline snapshot 26e3a825-27b4-425d-bcd5-e4fdcc4a47ee of volume 52d8f806-e9d3-4c7f-abcf-a1ce9608bacd {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] snapshot_file for this snap is: volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee18e7d5-0c0b-4739-8e4a-c8a434b00efb]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] Creating offline snapshot 8552595c-95fe-4a87-a9e1-ddaddbee7bd3 of volume b706028c-dd34-40d8-a9e6-fafa381ce088 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[89df8e33-cb7c-4685-9b40-1ab5587ebb7d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:32 devstack sudo[104815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee
Sep 16 08:55:32 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:32 devstack sudo[104816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088
Sep 16 08:55:32 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:32 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee" returned: 0 in 0.426s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d71e95f-035c-46fd-9130-ec4beaac9218]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:32 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088" returned: 0 in 0.443s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:32 devstack sudo[104826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3 1G
Sep 16 08:55:32 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:32 devstack sudo[104824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd
Sep 16 08:55:32 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:32 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd" returned: 0 in 0.363s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:32 devstack sudo[104835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee
Sep 16 08:55:32 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:32 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3 1G" returned: 0 in 0.478s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b706028c-dd34-40d8-a9e6-fafa381ce088 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:32 devstack sudo[104838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b706028c-dd34-40d8-a9e6-fafa381ce088 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3
Sep 16 08:55:32 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:33 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee" returned: 0 in 0.440s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:33 devstack sudo[104847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee
Sep 16 08:55:33 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:33 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b706028c-dd34-40d8-a9e6-fafa381ce088 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3" returned: 0 in 0.361s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:33 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3 is being set with open permissions: ugo+rw
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:33 devstack sudo[104850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3
Sep 16 08:55:33 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:33 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd.26e3a825-27b4-425d-bcd5-e4fdcc4a47ee" returned: 0 in 0.316s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-26e3a825-27b4-425d-bcd5-e4fdcc4a47ee" released by "_delete_snapshot" :: held 1.677s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd" released by "delete_snapshot" :: held 1.702s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:33 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3" returned: 0 in 0.305s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Created reservations ['48a8393f-650f-45b0-b4ac-796340e3e931', 'ce19fbf1-6a06-48fc-acb5-1705cf84be16', '8b30a44e-37b8-44bb-950b-f4ee9735e7ab', 'c55138b5-f144-437b-88fe-12971e53cba9'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:33 devstack sudo[104854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.info
Sep 16 08:55:33 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:33 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Delete snapshot completed successfully.
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-18b17348-a83d-4bad-9b97-e9267e116077 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-26e3a825-27b4-425d-bcd5-e4fdcc4a47ee-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:33 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.info" returned: 0 in 0.297s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:33 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.info is being set with open permissions: ugo+rw
Sep 16 08:55:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:33 devstack sudo[104857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.info
Sep 16 08:55:33 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "cinder-quobyte-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[72226022-3ba4-487a-8834-30311b7241fb]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:34 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.info" returned: 0 in 0.264s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.810s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] Creating offline snapshot 29c22331-4430-4a7a-9318-3001416ad23e of volume f9b7cbb3-91d7-4198-994c-6057bd77610b {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:55:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-87d3d8a1-6b0d-44fc-98ce-a26e06fd5c62 tempest-ProjectMemberTests-1200760860 None] Create snapshot completed successfully
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3656527c-b186-4b0d-8cfb-e0a5dde19c04]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:34 devstack sudo[104859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd
Sep 16 08:55:34 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:34 devstack sudo[104862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b
Sep 16 08:55:34 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:34 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd" returned: 0 in 0.378s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:34 devstack sudo[104867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd
Sep 16 08:55:34 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:34 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b" returned: 0 in 0.393s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:34 devstack sudo[104872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e 1G
Sep 16 08:55:34 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:34 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd" returned: 0 in 0.268s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-quobyte-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd" released by "delete_volume" :: held 0.717s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Created reservations ['5097ccbe-8d05-4a4c-8b75-b3a1422aa6b4', '7ec4aa44-22aa-48c2-afa0-14432975ec4e', '8fec97f0-bd7b-40e7-8bf4-f30f6dec146a', '92cfbccc-2c0b-461c-b8b2-e859d4725c75'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:34 devstack sudo[104879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:34 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-8552595c-95fe-4a87-a9e1-ddaddbee7bd3-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-8552595c-95fe-4a87-a9e1-ddaddbee7bd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-b706028c-dd34-40d8-a9e6-fafa381ce088" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-b706028c-dd34-40d8-a9e6-fafa381ce088" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-8552595c-95fe-4a87-a9e1-ddaddbee7bd3" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-8552595c-95fe-4a87-a9e1-ddaddbee7bd3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Deleting offline snapshot 8552595c-95fe-4a87-a9e1-ddaddbee7bd3 of volume b706028c-dd34-40d8-a9e6-fafa381ce088 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] snapshot_file for this snap is: volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f75a73-46fa-4bd4-a805-affa962e525f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:35 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e 1G" returned: 0 in 0.523s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b7cbb3-91d7-4198-994c-6057bd77610b -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:35 devstack sudo[104882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b7cbb3-91d7-4198-994c-6057bd77610b -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e
Sep 16 08:55:35 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:35 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.380s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:35 devstack sudo[104881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3
Sep 16 08:55:35 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:35 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Deleted volume successfully.
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-2c284fd8-4dad-4765-b44c-794108ee7919 tempest-CreateVolumesFromSnapshotTest-286226697 None] Lock "cinder-52d8f806-e9d3-4c7f-abcf-a1ce9608bacd-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:35 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b7cbb3-91d7-4198-994c-6057bd77610b -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e" returned: 0 in 0.391s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:35 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e is being set with open permissions: ugo+rw
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:35 devstack sudo[104891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e
Sep 16 08:55:35 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:35 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3" returned: 0 in 0.539s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b706028c-dd34-40d8-a9e6-fafa381ce088(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[621705ab-fd9c-4550-9ddf-0654335066a2]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:35 devstack sudo[104894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088
Sep 16 08:55:35 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:35 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e" returned: 0 in 0.306s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:35 devstack sudo[104897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.info
Sep 16 08:55:35 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:36 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088" returned: 0 in 0.485s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:36 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.info" returned: 0 in 0.320s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:36 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.info is being set with open permissions: ugo+rw
Sep 16 08:55:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:36 devstack sudo[104904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3
Sep 16 08:55:36 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:36 devstack sudo[104905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.info
Sep 16 08:55:36 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:36 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.info" returned: 0 in 0.336s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:36 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e143b890-7de4-4510-97e5-0d295648cab2 tempest-VolumeDependencyTests-1552316758 None] Create snapshot completed successfully
Sep 16 08:55:36 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3" returned: 0 in 0.496s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:36 devstack sudo[104913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3
Sep 16 08:55:36 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:36 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088.8552595c-95fe-4a87-a9e1-ddaddbee7bd3" returned: 0 in 0.257s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-8552595c-95fe-4a87-a9e1-ddaddbee7bd3" released by "_delete_snapshot" :: held 1.928s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-b706028c-dd34-40d8-a9e6-fafa381ce088" released by "delete_snapshot" :: held 1.967s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:37 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Created reservations ['6d417630-60b0-4da2-a346-133ac3439c39', '4c1c9415-e954-4470-9413-a621167b760e', '9c64df4c-f725-4f12-ae3f-403309d90595', '390c4fd5-f951-47ca-b768-2a668dbf3a81'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Delete snapshot completed successfully.
Sep 16 08:55:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-eb0c0c25-6b9d-4475-9ecd-e25d033cf733 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-8552595c-95fe-4a87-a9e1-ddaddbee7bd3-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-b706028c-dd34-40d8-a9e6-fafa381ce088-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Flow 'volume_create_manager' (c56388cc-2fb8-41b6-b94c-46ddc15c87eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1da42c-69c9-4424-afbc-88ffa45c43b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-b706028c-dd34-40d8-a9e6-fafa381ce088-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1da42c-69c9-4424-afbc-88ffa45c43b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-468059367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5392801-1413-4a92-9509-5d6dd8f9aab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbf4ba11cb8f4fbbb5b1713400cccb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=29c22331-4430-4a7a-9318-3001416ad23e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:38Z,use_quota=True,user_id='c5b5602d4d924a84916e7d14b7f2bb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1c22cc-2f82-463a-92f2-bbb3bbafbf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1c22cc-2f82-463a-92f2-bbb3bbafbf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838caa8b-ff9d-4208-a4e9-33500318fb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838caa8b-ff9d-4208-a4e9-33500318fb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5392801-1413-4a92-9509-5d6dd8f9aab1', 'volume_name': 'volume-a5392801-1413-4a92-9509-5d6dd8f9aab1', 'volume_size': 1, 'snapshot_id': '29c22331-4430-4a7a-9318-3001416ad23e'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e729b6a-1959-4f65-9772-348e0b24c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e729b6a-1959-4f65-9772-348e0b24c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2377eccf-d9f4-4698-ae5c-47e18660f53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:38 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Volume a5392801-1413-4a92-9509-5d6dd8f9aab1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5392801-1413-4a92-9509-5d6dd8f9aab1', 'volume_size': 1, 'snapshot_id': '29c22331-4430-4a7a-9318-3001416ad23e'}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "cinder-quobyte-29c22331-4430-4a7a-9318-3001416ad23e-a5392801-1413-4a92-9509-5d6dd8f9aab1" by "_create_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-quobyte-29c22331-4430-4a7a-9318-3001416ad23e-a5392801-1413-4a92-9509-5d6dd8f9aab1" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Creating volume a5392801-1413-4a92-9509-5d6dd8f9aab1 from snapshot 29c22331-4430-4a7a-9318-3001416ad23e {{(pid=86261) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "cinder-quobyte-a5392801-1413-4a92-9509-5d6dd8f9aab1" by "_copy_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-b706028c-dd34-40d8-a9e6-fafa381ce088" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-quobyte-a5392801-1413-4a92-9509-5d6dd8f9aab1" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] snapshot: 29c22331-4430-4a7a-9318-3001416ad23e, volume: a5392801-1413-4a92-9509-5d6dd8f9aab1,  {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-b706028c-dd34-40d8-a9e6-fafa381ce088" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c713a5-1df7-4e6d-9024-8fc478741d0d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6d0405-9824-43aa-b037-a24417d9a9c0]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:38 devstack sudo[104918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e
Sep 16 08:55:38 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:38 devstack sudo[104917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088
Sep 16 08:55:38 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:39 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e" returned: 0 in 0.419s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b7cbb3-91d7-4198-994c-6057bd77610b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:55:39 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088" returned: 0 in 0.448s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a375c0b-343b-4c09-af85-fc78aff93622]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:39 devstack sudo[104927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088
Sep 16 08:55:39 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:39 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b
Sep 16 08:55:39 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:39 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-b706028c-dd34-40d8-a9e6-fafa381ce088" returned: 0 in 0.342s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-b706028c-dd34-40d8-a9e6-fafa381ce088" released by "delete_volume" :: held 0.907s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Created reservations ['36440388-1089-4a67-ae42-e7fe0da53006', 'b47efade-d1cd-4a38-9717-4c6a1459a3e2', '5fa27e26-5350-4504-8b8a-340607deb48d', '7bf113cb-e323-4e84-91f8-e0f95f25839e'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:39 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b" returned: 0 in 0.513s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Creating direct copy from snapshot {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG cinder.utils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Path /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1 not found in is_blk_device check {{(pid=86261) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:39 devstack sudo[104937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1
Sep 16 08:55:39 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:39 devstack sudo[104939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:39 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:39 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.364s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:39 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:39 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Deleted volume successfully.
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-08faeb07-bf87-451b-9da1-1beaa860c788 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-b706028c-dd34-40d8-a9e6-fafa381ce088-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Flow 'volume_create_manager' (451e0c5e-dca3-4672-bb7f-72e81f4f082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2021c852-c812-411e-b944-048360e69d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2021c852-c812-411e-b944-048360e69d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403990205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ffa1756-e00e-4e2e-833e-a34529ea782e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb6aadf08524ab993297db904fa96f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:40Z,use_quota=True,user_id='03e2abafc78e473ea9e6cfd4907e928c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f13bffe-6a5c-4fc2-b634-b6c23260cfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f13bffe-6a5c-4fc2-b634-b6c23260cfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff36698-b48c-4e62-b722-41e981e7ed8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff36698-b48c-4e62-b722-41e981e7ed8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ffa1756-e00e-4e2e-833e-a34529ea782e', 'volume_name': 'volume-0ffa1756-e00e-4e2e-833e-a34529ea782e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81efda52-e6df-4ec3-9ec4-f76b930822fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81efda52-e6df-4ec3-9ec4-f76b930822fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1e4780-ba03-4a21-97f4-0be73262db67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:40 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Volume 0ffa1756-e00e-4e2e-833e-a34529ea782e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ffa1756-e00e-4e2e-833e-a34529ea782e', 'volume_size': 1}
Sep 16 08:55:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:41 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (0a44d718-635d-4ecf-97fb-7bcf452e2bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01feac0f-1372-4112-9a36-984fab8847aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01feac0f-1372-4112-9a36-984fab8847aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056830717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554b401a-ab48-4882-9ab1-8de08e42274b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:41Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc7ba3b-911f-44a0-a654-35a82541bd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc7ba3b-911f-44a0-a654-35a82541bd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2c5e1e-6342-4614-8a6b-84919de97642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2c5e1e-6342-4614-8a6b-84919de97642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '554b401a-ab48-4882-9ab1-8de08e42274b', 'volume_name': 'volume-554b401a-ab48-4882-9ab1-8de08e42274b', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af3a06c-8cd3-4cf6-aeb3-325611a19e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af3a06c-8cd3-4cf6-aeb3-325611a19e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:41 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5b269c-5c54-4007-95ac-252c394008e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:41 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Volume 554b401a-ab48-4882-9ab1-8de08e42274b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-554b401a-ab48-4882-9ab1-8de08e42274b', 'volume_size': 1}
Sep 16 08:55:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:43 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Flow 'volume_create_manager' (a366f1aa-4b1f-45a8-bd96-8d1746bc263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dff3502-ca6d-4382-ab6a-19e8e4207d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dff3502-ca6d-4382-ab6a-19e8e4207d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524716f3-f04a-4508-84df-0938a0bc7211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699c1d0fc36a4efb9e27a9bc5c393fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:43Z,use_quota=True,user_id='09b80b77de2d4b8ca30b91686cb6971d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e54c11-65cf-4764-8d97-5b8b6a87b271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e54c11-65cf-4764-8d97-5b8b6a87b271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef411e2-3b5a-4a7c-a242-2edc0dbd884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:43 devstack cinder-volume[86261]: DEBUG cinder.image.glance [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Creating Keystone auth plugin from conf {{(pid=86261) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 08:55:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef411e2-3b5a-4a7c-a242-2edc0dbd884b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '524716f3-f04a-4508-84df-0938a0bc7211', 'volume_name': 'volume-524716f3-f04a-4508-84df-0938a0bc7211', 'volume_size': 1, 'image_id': '77f07696-0601-4ab6-810d-32d7c33fbc0c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77f07696-0601-4ab6-810d-32d7c33fbc0c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '90c9258d8be3f55cafd31733c1bebd65', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '699c1d0fc36a4efb9e27a9bc5c393fc1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ae631db04c9f3bdec160ed6768c29c5aa27a1124ffbf337703795cbfd3c4e744a69e74e12ea746579bdc2ae7bda80e92631190be0280fb29df5907bea63ce38', 'id': '77f07696-0601-4ab6-810d-32d7c33fbc0c', 'created_at': datetime.datetime(2026, 9, 16, 6, 55, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 55, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77f07696-0601-4ab6-810d-32d7c33fbc0c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0e4d796a0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4821e2-e498-4d19-a543-12d5485ec363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4821e2-e498-4d19-a543-12d5485ec363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92350e4b-3a39-4a6a-befe-b371f5803e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:44 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Volume 524716f3-f04a-4508-84df-0938a0bc7211: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-524716f3-f04a-4508-84df-0938a0bc7211', 'volume_size': 1, 'image_id': '77f07696-0601-4ab6-810d-32d7c33fbc0c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77f07696-0601-4ab6-810d-32d7c33fbc0c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '90c9258d8be3f55cafd31733c1bebd65', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '699c1d0fc36a4efb9e27a9bc5c393fc1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ae631db04c9f3bdec160ed6768c29c5aa27a1124ffbf337703795cbfd3c4e744a69e74e12ea746579bdc2ae7bda80e92631190be0280fb29df5907bea63ce38', 'id': '77f07696-0601-4ab6-810d-32d7c33fbc0c', 'created_at': datetime.datetime(2026, 9, 16, 6, 55, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 55, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77f07696-0601-4ab6-810d-32d7c33fbc0c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0e4d796a0>}
Sep 16 08:55:44 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Trying to clone 524716f3-f04a-4508-84df-0938a0bc7211 from image 77f07696-0601-4ab6-810d-32d7c33fbc0c at location (None, [{'url': 'file:///opt/stack/data/glance/images/77f07696-0601-4ab6-810d-32d7c33fbc0c', 'metadata': {}}]). {{(pid=86261) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 08:55:44 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 08:55:44 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 08:55:44 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b6cfab-6b36-418d-ae52-f789f348c77c]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:44 devstack sudo[104954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD
Sep 16 08:55:44 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:45 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD" returned: 0 in 0.662s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:45 devstack sudo[104958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD
Sep 16 08:55:45 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:45 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:55:45 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Temporary image 77f07696-0601-4ab6-810d-32d7c33fbc0c is fetched for user 09b80b77de2d4b8ca30b91686cb6971d. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 08:55:45 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b758443-8674-4fe1-a3a8-9044b44757f0]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:45 devstack sudo[104963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD
Sep 16 08:55:45 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:46 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD" returned: 0 in 0.577s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:46 devstack sudo[104967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD
Sep 16 08:55:46 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:46 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD" returned: 1 in 0.648s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:55:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:47 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1" returned: 0 in 7.477s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:55:47 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Converted 1024.00 MB image at 136.93 MB/s
Sep 16 08:55:47 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1 is being set with open permissions: ugo+rw
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:47 devstack sudo[105006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1
Sep 16 08:55:47 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:47 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1" returned: 0 in 0.255s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-quobyte-a5392801-1413-4a92-9509-5d6dd8f9aab1" released by "_copy_volume_from_snapshot" :: held 8.821s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-quobyte-29c22331-4430-4a7a-9318-3001416ad23e-a5392801-1413-4a92-9509-5d6dd8f9aab1" released by "_create_volume_from_snapshot" :: held 8.894s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.915s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.734s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1403990205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ffa1756-e00e-4e2e-833e-a34529ea782e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb6aadf08524ab993297db904fa96f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:40Z,use_quota=True,user_id='03e2abafc78e473ea9e6cfd4907e928c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Creating volume 0ffa1756-e00e-4e2e-833e-a34529ea782e {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:47 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0ffa1756-e00e-4e2e-833e-a34529ea782e 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:47 devstack sudo[105011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0ffa1756-e00e-4e2e-833e-a34529ea782e 1073741824
Sep 16 08:55:47 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2377eccf-d9f4-4698-ae5c-47e18660f53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5392801-1413-4a92-9509-5d6dd8f9aab1', 'volume_size': 1, 'snapshot_id': '29c22331-4430-4a7a-9318-3001416ad23e'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d15cb6-093c-438a-895c-6871ff9f0ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:47 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Volume volume-a5392801-1413-4a92-9509-5d6dd8f9aab1 (a5392801-1413-4a92-9509-5d6dd8f9aab1): created successfully
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d15cb6-093c-438a-895c-6871ff9f0ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Flow 'volume_create_manager' (c56388cc-2fb8-41b6-b94c-46ddc15c87eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:47 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-6969c94f-e43a-4dc3-948c-09adc8ce4205 tempest-VolumeDependencyTests-1552316758 None] Created volume successfully.
Sep 16 08:55:47 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0ffa1756-e00e-4e2e-833e-a34529ea782e 1073741824" returned: 0 in 0.409s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0ffa1756-e00e-4e2e-833e-a34529ea782e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:47 devstack sudo[105017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0ffa1756-e00e-4e2e-833e-a34529ea782e
Sep 16 08:55:47 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:48 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0ffa1756-e00e-4e2e-833e-a34529ea782e" returned: 0 in 0.250s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.329s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056830717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554b401a-ab48-4882-9ab1-8de08e42274b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:41Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Creating volume 554b401a-ab48-4882-9ab1-8de08e42274b {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:48 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1e4780-ba03-4a21-97f4-0be73262db67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ffa1756-e00e-4e2e-833e-a34529ea782e', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:48 devstack sudo[105020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b 1073741824
Sep 16 08:55:48 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fb0b18-0401-434a-8ea4-2709e61567d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:48 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Volume volume-0ffa1756-e00e-4e2e-833e-a34529ea782e (0ffa1756-e00e-4e2e-833e-a34529ea782e): created successfully
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fb0b18-0401-434a-8ea4-2709e61567d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Flow 'volume_create_manager' (451e0c5e-dca3-4672-bb7f-72e81f4f082d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "cinder-29c22331-4430-4a7a-9318-3001416ad23e-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:48 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-69881858-2528-41d4-b86b-c088d44a9403 tempest-ProjectReaderTests-798488316 None] Created volume successfully.
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-29c22331-4430-4a7a-9318-3001416ad23e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "cinder-quobyte-f9b7cbb3-91d7-4198-994c-6057bd77610b" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-quobyte-f9b7cbb3-91d7-4198-994c-6057bd77610b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "cinder-quobyte-29c22331-4430-4a7a-9318-3001416ad23e" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-quobyte-29c22331-4430-4a7a-9318-3001416ad23e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Deleting offline snapshot 29c22331-4430-4a7a-9318-3001416ad23e of volume f9b7cbb3-91d7-4198-994c-6057bd77610b {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] snapshot_file for this snap is: volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec7adf2-4905-40d1-b2c2-72e86efa5980]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:48 devstack sudo[105022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e
Sep 16 08:55:48 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:48 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b 1073741824" returned: 0 in 0.420s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:48 devstack sudo[105028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b
Sep 16 08:55:48 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:48 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e" returned: 0 in 0.397s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b7cbb3-91d7-4198-994c-6057bd77610b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2dfe68-b786-4779-8c35-665d42d0205c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:48 devstack sudo[105032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b
Sep 16 08:55:48 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:48 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b" returned: 0 in 0.265s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524716f3-f04a-4508-84df-0938a0bc7211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699c1d0fc36a4efb9e27a9bc5c393fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:43Z,use_quota=True,user_id='09b80b77de2d4b8ca30b91686cb6971d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Creating volume 524716f3-f04a-4508-84df-0938a0bc7211 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:48 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5b269c-5c54-4007-95ac-252c394008e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-554b401a-ab48-4882-9ab1-8de08e42274b', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063d5788-3ab8-42ef-9027-06266dab0c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:48 devstack sudo[105035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211 1073741824
Sep 16 08:55:48 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:48 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Volume volume-554b401a-ab48-4882-9ab1-8de08e42274b (554b401a-ab48-4882-9ab1-8de08e42274b): created successfully
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063d5788-3ab8-42ef-9027-06266dab0c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (0a44d718-635d-4ecf-97fb-7bcf452e2bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:48 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-965f3642-ce90-4914-ab7d-a0008aeac41f tempest-ProjectMemberTests-1200760860 None] Created volume successfully.
Sep 16 08:55:49 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b" returned: 0 in 0.598s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:49 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Acquiring lock "cinder-0ffa1756-e00e-4e2e-833e-a34529ea782e-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211 1073741824" returned: 0 in 0.491s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:49 devstack sudo[105044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e
Sep 16 08:55:49 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Lock "cinder-0ffa1756-e00e-4e2e-833e-a34529ea782e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:49 devstack sudo[105046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Acquiring lock "cinder-quobyte-0ffa1756-e00e-4e2e-833e-a34529ea782e" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:49 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Lock "cinder-quobyte-0ffa1756-e00e-4e2e-833e-a34529ea782e" acquired by "delete_volume" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[56176a7e-a036-426f-bed2-f5fcd0d0a32b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0ffa1756-e00e-4e2e-833e-a34529ea782e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:49 devstack sudo[105048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0ffa1756-e00e-4e2e-833e-a34529ea782e
Sep 16 08:55:49 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:49 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211" returned: 0 in 0.257s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Attempting download of 77f07696-0601-4ab6-810d-32d7c33fbc0c ((None, [{'url': 'file:///opt/stack/data/glance/images/77f07696-0601-4ab6-810d-32d7c33fbc0c', 'metadata': {}}])) to volume 524716f3-f04a-4508-84df-0938a0bc7211. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 08:55:49 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e" returned: 0 in 0.412s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:49 devstack sudo[105054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e
Sep 16 08:55:49 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c64b1e-159f-4fc7-aef2-05a594b2aabb]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77f07696-0601-4ab6-810d-32d7c33fbc0c_p0hnpaml {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:49 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0ffa1756-e00e-4e2e-833e-a34529ea782e" returned: 0 in 0.407s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0ffa1756-e00e-4e2e-833e-a34529ea782e {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:49 devstack sudo[105056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77f07696-0601-4ab6-810d-32d7c33fbc0c_p0hnpaml
Sep 16 08:55:49 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:49 devstack sudo[105061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0ffa1756-e00e-4e2e-833e-a34529ea782e
Sep 16 08:55:49 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:49 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b.29c22331-4430-4a7a-9318-3001416ad23e" returned: 0 in 0.305s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-quobyte-29c22331-4430-4a7a-9318-3001416ad23e" released by "_delete_snapshot" :: held 1.868s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-quobyte-f9b7cbb3-91d7-4198-994c-6057bd77610b" released by "delete_snapshot" :: held 1.901s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:50 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77f07696-0601-4ab6-810d-32d7c33fbc0c_p0hnpaml" returned: 0 in 0.411s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77f07696-0601-4ab6-810d-32d7c33fbc0c_p0hnpaml {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:50 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0ffa1756-e00e-4e2e-833e-a34529ea782e" returned: 0 in 0.306s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Lock "cinder-quobyte-0ffa1756-e00e-4e2e-833e-a34529ea782e" released by "delete_volume" :: held 0.776s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Created reservations ['a9b2068c-73d6-4588-862d-8fd393808c7a', 'd415e4a8-dfff-4f2e-8270-9477306a8880', 'e2e6a5b4-5f51-411c-8d1c-46b6fa974ea3', '98e01da2-90d3-4058-abef-e5a963f78a88'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Created reservations ['f305b8d2-9653-43aa-a16a-ef18ad19e69b', 'ac513786-dfde-4953-a8ed-5198d760693e', '968294d9-ac92-433c-b7c5-bc159f22636d', 'bb5b3d7e-137f-4f04-b674-633ae1af6a73'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:50 devstack sudo[105067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77f07696-0601-4ab6-810d-32d7c33fbc0c_p0hnpaml
Sep 16 08:55:50 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] Creating offline snapshot 6e8a508e-f291-465d-b49a-a298972f4d29 of volume 554b401a-ab48-4882-9ab1-8de08e42274b {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c5e9ab-75bd-4008-ab7b-0ef7b50dc654]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Delete snapshot completed successfully.
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7a005812-bc91-4310-9727-ac56370e79b8 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-29c22331-4430-4a7a-9318-3001416ad23e-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:50 devstack sudo[105070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:50 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:50 devstack sudo[105069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b
Sep 16 08:55:50 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:50 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77f07696-0601-4ab6-810d-32d7c33fbc0c_p0hnpaml" returned: 1 in 0.396s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77f07696-0601-4ab6-810d-32d7c33fbc0c_p0hnpaml' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[54034ff2-3bc5-4735-ac8b-8f9f0bf3e8a1]: (4, 'raw') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:50 devstack sudo[105075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD
Sep 16 08:55:50 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:50 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.267s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Deleted volume successfully.
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1ef55c96-c610-47d2-8ef1-99ee5e500514 tempest-ProjectReaderTests-798488316 None] Lock "cinder-0ffa1756-e00e-4e2e-833e-a34529ea782e-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:50 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b" returned: 0 in 0.527s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:50 devstack sudo[105081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29 1G
Sep 16 08:55:50 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:50 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:50 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:51 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD
Sep 16 08:55:51 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Flow 'volume_create_manager' (ed80f026-c6a2-4713-aa9f-148b2dd55704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c939684-9916-401a-9100-74b4cd49aae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c939684-9916-401a-9100-74b4cd49aae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665260781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb086b3-8a13-4fed-80b4-d10fe8f9d1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb6aadf08524ab993297db904fa96f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:51Z,use_quota=True,user_id='03e2abafc78e473ea9e6cfd4907e928c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cdedeee-9e8e-4bbc-856c-51f11e08bbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cdedeee-9e8e-4bbc-856c-51f11e08bbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a9bd5d-28ae-4ebe-aa63-9acfe22a9bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a9bd5d-28ae-4ebe-aa63-9acfe22a9bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abb086b3-8a13-4fed-80b4-d10fe8f9d1de', 'volume_name': 'volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1595d90f-1a1d-4ee8-9fe6-92e6cba45678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1595d90f-1a1d-4ee8-9fe6-92e6cba45678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e331de-cc3a-4af2-aaed-c4605da94ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:51 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Volume abb086b3-8a13-4fed-80b4-d10fe8f9d1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de', 'volume_size': 1}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:51 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29 1G" returned: 0 in 0.418s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-554b401a-ab48-4882-9ab1-8de08e42274b -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:51 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] 77f07696-0601-4ab6-810d-32d7c33fbc0c was raw, converting to qcow2 {{(pid=86261) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 08:55:51 devstack sudo[105093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-554b401a-ab48-4882-9ab1-8de08e42274b -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29
Sep 16 08:55:51 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:51 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211
Sep 16 08:55:51 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "cinder-f9b7cbb3-91d7-4198-994c-6057bd77610b-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-f9b7cbb3-91d7-4198-994c-6057bd77610b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "cinder-quobyte-f9b7cbb3-91d7-4198-994c-6057bd77610b" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-quobyte-f9b7cbb3-91d7-4198-994c-6057bd77610b" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b88119c-62a0-4c1f-a905-03a107c3b0c5]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:51 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-554b401a-ab48-4882-9ab1-8de08e42274b -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29" returned: 0 in 0.356s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:51 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29 is being set with open permissions: ugo+rw
Sep 16 08:55:51 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b
Sep 16 08:55:51 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:51 devstack sudo[105105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29
Sep 16 08:55:51 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:51 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211" returned: 0 in 0.527s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77f07696-0601-4ab6-810d-32d7c33fbc0c_p4hp2aysdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211 {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:55:51 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:51 devstack sudo[105108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211 1G
Sep 16 08:55:51 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:51 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29" returned: 0 in 0.278s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:51 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b" returned: 0 in 0.460s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:51 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.info
Sep 16 08:55:51 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:51 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b
Sep 16 08:55:51 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:52 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211 1G" returned: 0 in 0.340s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Downloaded image 77f07696-0601-4ab6-810d-32d7c33fbc0c ((None, [{'url': 'file:///opt/stack/data/glance/images/77f07696-0601-4ab6-810d-32d7c33fbc0c', 'metadata': {}}])) to volume 524716f3-f04a-4508-84df-0938a0bc7211 successfully. {{(pid=86261) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Temporary image 77f07696-0601-4ab6-810d-32d7c33fbc0c for user 09b80b77de2d4b8ca30b91686cb6971d is deleted. {{(pid=86261) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.volume_utils [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Marking volume 524716f3-f04a-4508-84df-0938a0bc7211 as bootable. {{(pid=86261) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Copying metadata from image 77f07696-0601-4ab6-810d-32d7c33fbc0c to 524716f3-f04a-4508-84df-0938a0bc7211. {{(pid=86261) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Creating volume glance metadata for volume 524716f3-f04a-4508-84df-0938a0bc7211 backed by image 77f07696-0601-4ab6-810d-32d7c33fbc0c with: {'image_id': '77f07696-0601-4ab6-810d-32d7c33fbc0c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '90c9258d8be3f55cafd31733c1bebd65', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86261) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 08:55:52 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-f9b7cbb3-91d7-4198-994c-6057bd77610b" returned: 0 in 0.274s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:52 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.info" returned: 0 in 0.313s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:52 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.info is being set with open permissions: ugo+rw
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-quobyte-f9b7cbb3-91d7-4198-994c-6057bd77610b" released by "delete_volume" :: held 0.823s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:52 devstack sudo[105123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.info
Sep 16 08:55:52 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92350e4b-3a39-4a6a-befe-b371f5803e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524716f3-f04a-4508-84df-0938a0bc7211', 'volume_size': 1, 'image_id': '77f07696-0601-4ab6-810d-32d7c33fbc0c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77f07696-0601-4ab6-810d-32d7c33fbc0c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '90c9258d8be3f55cafd31733c1bebd65', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '699c1d0fc36a4efb9e27a9bc5c393fc1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ae631db04c9f3bdec160ed6768c29c5aa27a1124ffbf337703795cbfd3c4e744a69e74e12ea746579bdc2ae7bda80e92631190be0280fb29df5907bea63ce38', 'id': '77f07696-0601-4ab6-810d-32d7c33fbc0c', 'created_at': datetime.datetime(2026, 9, 16, 6, 55, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 6, 55, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77f07696-0601-4ab6-810d-32d7c33fbc0c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73e0e4d796a0>}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b82ce5-db11-4e70-a43f-45d7b8f233d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:52 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Volume volume-524716f3-f04a-4508-84df-0938a0bc7211 (524716f3-f04a-4508-84df-0938a0bc7211): created successfully
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b82ce5-db11-4e70-a43f-45d7b8f233d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Flow 'volume_create_manager' (a366f1aa-4b1f-45a8-bd96-8d1746bc263f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:52 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f37a9f22-222e-41ec-a6bb-fbe0687be43e tempest-VolumeImageDependencyTests-1964792860 None] Created volume successfully.
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Created reservations ['3f07d990-b3d7-4f39-94f5-7669254f6274', '69a9ba69-01e0-4e44-b9e9-a1fde537eeee', '04c5912b-4760-4cd2-8b34-52030c8288a1', '4fb796fc-7f78-4a5f-acd7-f99516eaea95'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:52 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:52 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:52 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.info" returned: 0 in 0.292s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.412s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665260781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb086b3-8a13-4fed-80b4-d10fe8f9d1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb6aadf08524ab993297db904fa96f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:51Z,use_quota=True,user_id='03e2abafc78e473ea9e6cfd4907e928c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Creating volume abb086b3-8a13-4fed-80b4-d10fe8f9d1de {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:52 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:52 devstack sudo[105128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de 1073741824
Sep 16 08:55:52 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:52 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c481d8fb-702c-4b0d-80ee-a9cae4123b80 tempest-ProjectMemberTests-1200760860 None] Create snapshot completed successfully
Sep 16 08:55:52 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.275s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:52 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Deleted volume successfully.
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-97094df4-1c46-4d5d-85d4-80e1b59d445f tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-f9b7cbb3-91d7-4198-994c-6057bd77610b-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "cinder-a5392801-1413-4a92-9509-5d6dd8f9aab1-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-a5392801-1413-4a92-9509-5d6dd8f9aab1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "cinder-quobyte-a5392801-1413-4a92-9509-5d6dd8f9aab1" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-quobyte-a5392801-1413-4a92-9509-5d6dd8f9aab1" acquired by "delete_volume" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f11728c-a8c3-41e7-b201-e6f1228651e3]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Acquiring lock "cinder-524716f3-f04a-4508-84df-0938a0bc7211-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Lock "cinder-524716f3-f04a-4508-84df-0938a0bc7211-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:53 devstack sudo[105134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1
Sep 16 08:55:53 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Acquiring lock "cinder-quobyte-524716f3-f04a-4508-84df-0938a0bc7211" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Lock "cinder-quobyte-524716f3-f04a-4508-84df-0938a0bc7211" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:53 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de 1073741824" returned: 0 in 0.606s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4ad2db-d249-41f5-b7dc-ca2f25e8ff02]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:53 devstack sudo[105138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de
Sep 16 08:55:53 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:53 devstack sudo[105137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211
Sep 16 08:55:53 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-6e8a508e-f291-465d-b49a-a298972f4d29-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-6e8a508e-f291-465d-b49a-a298972f4d29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-554b401a-ab48-4882-9ab1-8de08e42274b" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-554b401a-ab48-4882-9ab1-8de08e42274b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-6e8a508e-f291-465d-b49a-a298972f4d29" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:53 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1" returned: 0 in 0.499s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-6e8a508e-f291-465d-b49a-a298972f4d29" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Deleting offline snapshot 6e8a508e-f291-465d-b49a-a298972f4d29 of volume 554b401a-ab48-4882-9ab1-8de08e42274b {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:55:53 devstack sudo[105145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1
Sep 16 08:55:53 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] snapshot_file for this snap is: volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb58e61-fcec-42f1-afce-d12a19779cd4]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:53 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de" returned: 0 in 0.345s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e331de-cc3a-4af2-aaed-c4605da94ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25c3408-c754-433c-b1d6-fcd94612044a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:53 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Volume volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de (abb086b3-8a13-4fed-80b4-d10fe8f9d1de): created successfully
Sep 16 08:55:53 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25c3408-c754-433c-b1d6-fcd94612044a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Flow 'volume_create_manager' (ed80f026-c6a2-4713-aa9f-148b2dd55704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211" returned: 0 in 0.448s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:53 devstack sudo[105149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29
Sep 16 08:55:53 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:53 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d612520a-7d73-439b-9cd5-2438d9c298e6 tempest-ProjectReaderTests-798488316 None] Created volume successfully.
Sep 16 08:55:53 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211
Sep 16 08:55:53 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:53 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-a5392801-1413-4a92-9509-5d6dd8f9aab1" returned: 0 in 0.299s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-quobyte-a5392801-1413-4a92-9509-5d6dd8f9aab1" released by "delete_volume" :: held 0.846s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Created reservations ['01d8776e-c706-4844-8750-34a68a06ef5b', 'ce6e898f-10ba-4e8c-a382-5eec0e75d712', '7c541fa0-3781-485c-8233-ba639da662a6', '7616aaa2-e5f9-410f-bdf1-51d6c9d57566'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:53 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:53 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:53 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-524716f3-f04a-4508-84df-0938a0bc7211" returned: 0 in 0.300s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Lock "cinder-quobyte-524716f3-f04a-4508-84df-0938a0bc7211" released by "delete_volume" :: held 0.800s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:53 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29" returned: 0 in 0.457s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-554b401a-ab48-4882-9ab1-8de08e42274b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31afebd-7259-4abe-be95-896feacb69d3]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Created reservations ['cc9ff326-89ed-47fa-b0e7-0300acf64b82', 'e4c1f37a-faea-48d0-9231-e02d16c3a55f', '6cf8b4ff-19b3-4df9-9d3f-83a2ba0b3733', 'e8cab683-919d-46a9-95f2-58fb5033ac8e'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:54 devstack sudo[105163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b
Sep 16 08:55:54 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:54 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.401s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Acquiring lock "cinder-abb086b3-8a13-4fed-80b4-d10fe8f9d1de-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:54 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Deleted volume successfully.
Sep 16 08:55:54 devstack sudo[105166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:54 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Lock "cinder-abb086b3-8a13-4fed-80b4-d10fe8f9d1de-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-90e1af33-1322-4462-85c9-66007fb8a786 tempest-VolumeDependencyTests-1552316758 None] Lock "cinder-a5392801-1413-4a92-9509-5d6dd8f9aab1-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Acquiring lock "cinder-quobyte-abb086b3-8a13-4fed-80b4-d10fe8f9d1de" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Lock "cinder-quobyte-abb086b3-8a13-4fed-80b4-d10fe8f9d1de" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a253af5a-b050-4785-955f-fb10ed680bfd]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:54 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.360s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:54 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b" returned: 0 in 0.595s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:54 devstack sudo[105171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de
Sep 16 08:55:54 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:54 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Deleted volume successfully.
Sep 16 08:55:54 devstack sudo[105179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29
Sep 16 08:55:54 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0a4afd93-20fe-4189-912f-f6bfbefb2a4d tempest-VolumeImageDependencyTests-1964792860 None] Lock "cinder-524716f3-f04a-4508-84df-0938a0bc7211-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:54 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de" returned: 0 in 0.480s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:54 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de
Sep 16 08:55:54 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:55 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29" returned: 0 in 0.437s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:55 devstack sudo[105190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29
Sep 16 08:55:55 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:55 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-abb086b3-8a13-4fed-80b4-d10fe8f9d1de" returned: 0 in 0.324s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Lock "cinder-quobyte-abb086b3-8a13-4fed-80b4-d10fe8f9d1de" released by "delete_volume" :: held 0.871s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:55 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b.6e8a508e-f291-465d-b49a-a298972f4d29" returned: 0 in 0.310s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Created reservations ['6d041256-4c2b-4071-94e3-d9c7437e3084', '12510e8d-3abe-48a2-8ff3-5949ef9b1ea5', '45c1c5d8-8b45-43a3-a6e7-f487179abf26', '47ed9c9d-fb7f-4c34-af1c-8ecbe90e7ab8'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-6e8a508e-f291-465d-b49a-a298972f4d29" released by "_delete_snapshot" :: held 1.990s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-554b401a-ab48-4882-9ab1-8de08e42274b" released by "delete_snapshot" :: held 2.045s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:55 devstack sudo[105195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Created reservations ['a872ddba-668b-456b-8796-d32999a04419', 'ab950adc-163b-410d-99c4-c5a40853f8f3', '6cb6007e-240f-469e-92de-98850ef6dd35', 'caf2a6ef-cbe7-41b8-97ce-c543bd21eaa8'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:55 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:55 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Delete snapshot completed successfully.
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6783bee7-fe3f-49c7-9753-5b705a26fb98 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-6e8a508e-f291-465d-b49a-a298972f4d29-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:55 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.335s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:55 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Deleted volume successfully.
Sep 16 08:55:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-487d3a49-b1b2-44f2-8b14-a4f251cf47fc tempest-ProjectReaderTests-798488316 None] Lock "cinder-abb086b3-8a13-4fed-80b4-d10fe8f9d1de-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-554b401a-ab48-4882-9ab1-8de08e42274b-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-554b401a-ab48-4882-9ab1-8de08e42274b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-554b401a-ab48-4882-9ab1-8de08e42274b" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-554b401a-ab48-4882-9ab1-8de08e42274b" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:56 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4ae37a-8e73-4095-b408-85a6352d8c0f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:55:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:57 devstack sudo[105198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b
Sep 16 08:55:57 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Flow 'volume_create_manager' (bf2fd8d1-5c1d-4ff7-86ea-2bebc9ff13fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c670da81-3452-4d8c-97ec-53d87b11c928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c670da81-3452-4d8c-97ec-53d87b11c928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079627217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff90bca-54b9-44f3-92aa-7d57aefa8282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb6aadf08524ab993297db904fa96f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:57Z,use_quota=True,user_id='03e2abafc78e473ea9e6cfd4907e928c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514a4b3d-004f-45b9-8268-f8ebf2935582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514a4b3d-004f-45b9-8268-f8ebf2935582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45820922-46a8-4cca-bc4a-063f1ab08544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45820922-46a8-4cca-bc4a-063f1ab08544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff90bca-54b9-44f3-92aa-7d57aefa8282', 'volume_name': 'volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4680d3f-d5ea-4172-91c6-a391a2894d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4680d3f-d5ea-4172-91c6-a391a2894d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b70f7f2-229d-458d-b251-7830071ecf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:57 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Volume 1ff90bca-54b9-44f3-92aa-7d57aefa8282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282', 'volume_size': 1}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079627217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff90bca-54b9-44f3-92aa-7d57aefa8282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb6aadf08524ab993297db904fa96f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:57Z,use_quota=True,user_id='03e2abafc78e473ea9e6cfd4907e928c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Creating volume 1ff90bca-54b9-44f3-92aa-7d57aefa8282 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:57 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:57 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b" returned: 0 in 0.448s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:57 devstack sudo[105203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282 1073741824
Sep 16 08:55:57 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:57 devstack sudo[105204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b
Sep 16 08:55:57 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:57 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-554b401a-ab48-4882-9ab1-8de08e42274b" returned: 0 in 0.369s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-554b401a-ab48-4882-9ab1-8de08e42274b" released by "delete_volume" :: held 0.929s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Created reservations ['e5c0da9c-6fc2-44f9-b4d4-53671ff16560', '049e7fb9-d5c7-45d6-ad5b-3741040d2630', 'de3beabb-dae6-403a-8921-f1e3e191c4da', '2213afb3-0389-4167-a0bd-dfa2ed9ff0df'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:55:57 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282 1073741824" returned: 0 in 0.589s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:58 devstack sudo[105213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282
Sep 16 08:55:58 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:58 devstack sudo[105215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:55:58 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Flow 'volume_create_manager' (e6179bb2-3601-4df8-af79-4f049aa34b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb5e859-fa81-4abb-a0dd-dd72bc035c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb5e859-fa81-4abb-a0dd-dd72bc035c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e874630-30ce-4452-b658-1f8f6ada7084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336d4a31311d4af98ddf377eb9046cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:58Z,use_quota=True,user_id='e51efcca9d20416a9c9e974f6bf3e551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e9f5e2-328e-4e13-821b-f38ce0324112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:58 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e9f5e2-328e-4e13-821b-f38ce0324112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1978965c-b8c9-4a91-914a-441a593804c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1978965c-b8c9-4a91-914a-441a593804c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e874630-30ce-4452-b658-1f8f6ada7084', 'volume_name': 'volume-1e874630-30ce-4452-b658-1f8f6ada7084', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c46fc29-74d3-41f8-8140-d893fa16940b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c46fc29-74d3-41f8-8140-d893fa16940b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df84302b-6d4c-4b59-9983-f1e352fce1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:58 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Volume 1e874630-30ce-4452-b658-1f8f6ada7084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e874630-30ce-4452-b658-1f8f6ada7084', 'volume_size': 1}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282" returned: 0 in 0.348s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e874630-30ce-4452-b658-1f8f6ada7084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336d4a31311d4af98ddf377eb9046cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:58Z,use_quota=True,user_id='e51efcca9d20416a9c9e974f6bf3e551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Creating volume 1e874630-30ce-4452-b658-1f8f6ada7084 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:58 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e874630-30ce-4452-b658-1f8f6ada7084 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b70f7f2-229d-458d-b251-7830071ecf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:58 devstack sudo[105218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e874630-30ce-4452-b658-1f8f6ada7084 1073741824
Sep 16 08:55:58 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78595b2c-196b-4b4c-8a28-7adb8aa2a145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:58 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Volume volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282 (1ff90bca-54b9-44f3-92aa-7d57aefa8282): created successfully
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78595b2c-196b-4b4c-8a28-7adb8aa2a145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Flow 'volume_create_manager' (bf2fd8d1-5c1d-4ff7-86ea-2bebc9ff13fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:58 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.349s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:55:58 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Deleted volume successfully.
Sep 16 08:55:58 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b2a79fb5-e6f5-43ff-b2a3-12a9d81a1da7 tempest-ProjectReaderTests-798488316 None] Created volume successfully.
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-fb62e11b-61ff-4794-b170-fe371f2f4cb7 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-554b401a-ab48-4882-9ab1-8de08e42274b-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:55:58 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e874630-30ce-4452-b658-1f8f6ada7084 1073741824" returned: 0 in 0.458s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e874630-30ce-4452-b658-1f8f6ada7084 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:58 devstack sudo[105227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e874630-30ce-4452-b658-1f8f6ada7084
Sep 16 08:55:58 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:59 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e874630-30ce-4452-b658-1f8f6ada7084" returned: 0 in 0.262s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df84302b-6d4c-4b59-9983-f1e352fce1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e874630-30ce-4452-b658-1f8f6ada7084', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38489b9f-c5cc-4484-9037-3c8c24b56153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:59 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Volume volume-1e874630-30ce-4452-b658-1f8f6ada7084 (1e874630-30ce-4452-b658-1f8f6ada7084): created successfully
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38489b9f-c5cc-4484-9037-3c8c24b56153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Flow 'volume_create_manager' (e6179bb2-3601-4df8-af79-4f049aa34b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:59 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-bfa54150-ebca-493f-8d0b-5c5f7c020e62 tempest-CinderUnicodeTest-1331093156 None] Created volume successfully.
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (ab269cf3-d1bd-4d43-9418-db6704e0feb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2a4d1d-3ac4-4b10-a378-e563c14137cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2a4d1d-3ac4-4b10-a378-e563c14137cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1619997431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c950c8e0-12dd-486a-9ee5-cc4efb0c83bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:59Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96853461-506c-4c10-9418-65f19c969970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96853461-506c-4c10-9418-65f19c969970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28847bc-b6b4-4dd1-8980-e67977675145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28847bc-b6b4-4dd1-8980-e67977675145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c950c8e0-12dd-486a-9ee5-cc4efb0c83bf', 'volume_name': 'volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da662d84-1d9d-4ebd-b7ad-28e797ea9bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da662d84-1d9d-4ebd-b7ad-28e797ea9bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48297c92-fb73-4c94-9b0e-3822a519cf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:55:59 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Volume c950c8e0-12dd-486a-9ee5-cc4efb0c83bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf', 'volume_size': 1}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1619997431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c950c8e0-12dd-486a-9ee5-cc4efb0c83bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:55:59Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Creating volume c950c8e0-12dd-486a-9ee5-cc4efb0c83bf {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:55:59 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:55:59 devstack sudo[105230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf 1073741824
Sep 16 08:55:59 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-f78b5826-f5a1-4c17-b831-1ac3692b3500 tempest-ProjectAdminTests-1433926459 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.93851852417, 'free_capacity_gb': 1775.93851852417, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86261) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Acquiring lock "cinder-1ff90bca-54b9-44f3-92aa-7d57aefa8282-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Lock "cinder-1ff90bca-54b9-44f3-92aa-7d57aefa8282-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Acquiring lock "cinder-quobyte-1ff90bca-54b9-44f3-92aa-7d57aefa8282" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:55:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Lock "cinder-quobyte-1ff90bca-54b9-44f3-92aa-7d57aefa8282" acquired by "delete_volume" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07251ab-b1fd-4f50-8124-fa906eb1e032]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Flow 'volume_create_manager' (d2742626-7afb-4d72-baa9-63661a82a5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:00 devstack sudo[105235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282
Sep 16 08:56:00 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf4c492-693f-43fe-a087-6861e39e2ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf4c492-693f-43fe-a087-6861e39e2ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-906821038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7170b89d-1d91-4b08-ac27-3c42c4fe2739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336d4a31311d4af98ddf377eb9046cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:00Z,use_quota=True,user_id='e51efcca9d20416a9c9e974f6bf3e551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff504f0-0184-4495-b57b-a4ead6916c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff504f0-0184-4495-b57b-a4ead6916c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449167e4-87fb-4260-a094-72f8451d6e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449167e4-87fb-4260-a094-72f8451d6e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7170b89d-1d91-4b08-ac27-3c42c4fe2739', 'volume_name': 'volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad862ce2-1c4a-4e62-954b-a45a95c40784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad862ce2-1c4a-4e62-954b-a45a95c40784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac77301c-f9ca-4d43-8cf0-20fba04ca831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:00 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Volume 7170b89d-1d91-4b08-ac27-3c42c4fe2739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739', 'volume_size': 1}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:00 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf 1073741824" returned: 0 in 0.612s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:00 devstack sudo[105238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf
Sep 16 08:56:00 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:00 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282" returned: 0 in 0.462s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:00 devstack sudo[105244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282
Sep 16 08:56:00 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:00 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf" returned: 0 in 0.309s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-906821038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7170b89d-1d91-4b08-ac27-3c42c4fe2739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336d4a31311d4af98ddf377eb9046cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:00Z,use_quota=True,user_id='e51efcca9d20416a9c9e974f6bf3e551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Creating volume 7170b89d-1d91-4b08-ac27-3c42c4fe2739 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:00 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:00 devstack sudo[105247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739 1073741824
Sep 16 08:56:00 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48297c92-fb73-4c94-9b0e-3822a519cf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cfc85f-fbc4-487e-8786-ecb8f9606c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:00 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Volume volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf (c950c8e0-12dd-486a-9ee5-cc4efb0c83bf): created successfully
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cfc85f-fbc4-487e-8786-ecb8f9606c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (ab269cf3-d1bd-4d43-9418-db6704e0feb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:00 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d41b7480-ace8-4371-be83-dc086b40c91b tempest-ProjectMemberTests-1200760860 None] Created volume successfully.
Sep 16 08:56:00 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1ff90bca-54b9-44f3-92aa-7d57aefa8282" returned: 0 in 0.297s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Lock "cinder-quobyte-1ff90bca-54b9-44f3-92aa-7d57aefa8282" released by "delete_volume" :: held 0.812s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Created reservations ['47fcf2a2-71a5-4215-a6f3-c3c0665b2fe6', '36b8b7ca-62f6-45e5-ab8b-ab9170823b42', '35b86bff-f723-4ae6-8f32-f8b8aa7cf763', '58c3928b-c527-4455-abae-bcb2b9e63a4a'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:00 devstack sudo[105253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:00 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:01 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739 1073741824" returned: 0 in 0.569s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:01 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.356s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:01 devstack sudo[105257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739
Sep 16 08:56:01 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:01 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Deleted volume successfully.
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b91a60d4-3306-4a5a-ad08-78e85c944612 tempest-ProjectReaderTests-798488316 None] Lock "cinder-1ff90bca-54b9-44f3-92aa-7d57aefa8282-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:01 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739" returned: 0 in 0.273s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac77301c-f9ca-4d43-8cf0-20fba04ca831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907491eb-3f73-49ae-b47b-b2d1b4fb8f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:01 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Volume volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739 (7170b89d-1d91-4b08-ac27-3c42c4fe2739): created successfully
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907491eb-3f73-49ae-b47b-b2d1b4fb8f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Flow 'volume_create_manager' (d2742626-7afb-4d72-baa9-63661a82a5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:01 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b0863a22-d55f-43a0-9c0e-f07094ea164f tempest-CinderUnicodeTest-1331093156 None] Created volume successfully.
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Flow 'volume_create_manager' (c1ac9792-66d3-4b75-9920-757f4595b406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc4730b-7e6b-4a89-be90-d461a8752ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc4730b-7e6b-4a89-be90-d461a8752ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736526950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92df43c8-dafa-4b67-a9a4-a0c776751dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb6aadf08524ab993297db904fa96f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:02Z,use_quota=True,user_id='03e2abafc78e473ea9e6cfd4907e928c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a014ec-630b-49a6-a883-96946cdaeace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a014ec-630b-49a6-a883-96946cdaeace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6462e36f-1a5c-4adf-af83-fbc8f5563829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6462e36f-1a5c-4adf-af83-fbc8f5563829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92df43c8-dafa-4b67-a9a4-a0c776751dc9', 'volume_name': 'volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67cfccc-d7e3-4a80-9416-7287218ae2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67cfccc-d7e3-4a80-9416-7287218ae2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e1c2f4-aa6c-4731-8cdc-ae3e3ab8d9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:01 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Volume 92df43c8-dafa-4b67-a9a4-a0c776751dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9', 'volume_size': 1}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736526950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92df43c8-dafa-4b67-a9a4-a0c776751dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb6aadf08524ab993297db904fa96f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:02Z,use_quota=True,user_id='03e2abafc78e473ea9e6cfd4907e928c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Creating volume 92df43c8-dafa-4b67-a9a4-a0c776751dc9 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:01 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:01 devstack sudo[105261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9 1073741824
Sep 16 08:56:01 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:02 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9 1073741824" returned: 0 in 0.557s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=240,cinder:UPDATE=334,cinder:INSERT=95,cinder:DELETE=24 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=237,cinder:UPDATE=322,cinder:INSERT=77,cinder:DELETE=35 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:02 devstack sudo[105267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9
Sep 16 08:56:02 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:02 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9" returned: 0 in 0.292s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.845s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e1c2f4-aa6c-4731-8cdc-ae3e3ab8d9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2eb4a0-1ee9-4c28-94b9-b896a1d5873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] Creating offline snapshot 161a0779-6361-404e-b130-3dfc7a2d6f26 of volume c950c8e0-12dd-486a-9ee5-cc4efb0c83bf {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:02 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Volume volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9 (92df43c8-dafa-4b67-a9a4-a0c776751dc9): created successfully
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2eb4a0-1ee9-4c28-94b9-b896a1d5873e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Flow 'volume_create_manager' (c1ac9792-66d3-4b75-9920-757f4595b406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd3eab3-b32e-4e47-aa6d-e2ac7d30d242]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:02 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-76309342-d5b1-49dc-ba99-b0ee51d759c9 tempest-ProjectReaderTests-798488316 None] Created volume successfully.
Sep 16 08:56:02 devstack sudo[105270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf
Sep 16 08:56:02 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:03 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf" returned: 0 in 0.402s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:03 devstack sudo[105275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26 1G
Sep 16 08:56:03 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:03 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26 1G" returned: 0 in 0.489s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:03 devstack sudo[105281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26
Sep 16 08:56:03 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:03 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Acquiring lock "cinder-92df43c8-dafa-4b67-a9a4-a0c776751dc9-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:03 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Lock "cinder-92df43c8-dafa-4b67-a9a4-a0c776751dc9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:03 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Acquiring lock "cinder-quobyte-92df43c8-dafa-4b67-a9a4-a0c776751dc9" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:03 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Lock "cinder-quobyte-92df43c8-dafa-4b67-a9a4-a0c776751dc9" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:03 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1448ca-cdca-44cc-a43f-0c2e8876c208]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:04 devstack sudo[105283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9
Sep 16 08:56:04 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:04 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26" returned: 0 in 0.383s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:04 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26 is being set with open permissions: ugo+rw
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:04 devstack sudo[105288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26
Sep 16 08:56:04 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:04 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9" returned: 0 in 0.391s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:04 devstack sudo[105294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9
Sep 16 08:56:04 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:04 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26" returned: 0 in 0.281s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:04 devstack sudo[105296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.info
Sep 16 08:56:04 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:04 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-92df43c8-dafa-4b67-a9a4-a0c776751dc9" returned: 0 in 0.259s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Lock "cinder-quobyte-92df43c8-dafa-4b67-a9a4-a0c776751dc9" released by "delete_volume" :: held 0.710s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Created reservations ['1e378fb0-430d-4dbc-9372-d84a733a7034', 'a71c1a6c-125e-45f0-ac6b-f14eed942c07', '46e9c31a-e94a-43da-880f-05da2abb85a5', 'bf082637-b14f-40a2-a269-48dc7987a958'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:04 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.info" returned: 0 in 0.278s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:04 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.info is being set with open permissions: ugo+rw
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:04 devstack sudo[105300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.info
Sep 16 08:56:04 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:04 devstack sudo[105302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:04 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:04 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.info" returned: 0 in 0.285s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.553s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] Creating offline snapshot d3683d03-14de-42dd-a0b5-0a20fc612a63 of volume 7170b89d-1d91-4b08-ac27-3c42c4fe2739 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:05 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:05 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-20e60565-0778-4620-992d-c366c819388c tempest-ProjectMemberTests-1200760860 None] Create snapshot completed successfully
Sep 16 08:56:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.287s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:05 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:05 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c180d1d-e4cf-456e-ba6d-51ebf1a6e717]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:05 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Deleted volume successfully.
Sep 16 08:56:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d0f86fc2-57db-4144-b5d0-21728ace94a4 tempest-ProjectReaderTests-798488316 None] Lock "cinder-92df43c8-dafa-4b67-a9a4-a0c776751dc9-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:05 devstack sudo[105306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739
Sep 16 08:56:05 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:05 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739" returned: 0 in 0.424s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:05 devstack sudo[105311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63 1G
Sep 16 08:56:05 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:05 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63 1G" returned: 0 in 0.513s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:06 devstack sudo[105317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63
Sep 16 08:56:06 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-161a0779-6361-404e-b130-3dfc7a2d6f26-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-161a0779-6361-404e-b130-3dfc7a2d6f26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-161a0779-6361-404e-b130-3dfc7a2d6f26" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-161a0779-6361-404e-b130-3dfc7a2d6f26" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Deleting offline snapshot 161a0779-6361-404e-b130-3dfc7a2d6f26 of volume c950c8e0-12dd-486a-9ee5-cc4efb0c83bf {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] snapshot_file for this snap is: volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[747482b1-0158-4a94-8178-54c8ed1a597e]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:06 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63" returned: 0 in 0.416s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:06 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63 is being set with open permissions: ugo+rw
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:06 devstack sudo[105323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63
Sep 16 08:56:06 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:06 devstack sudo[105321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26
Sep 16 08:56:06 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:06 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63" returned: 0 in 0.393s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:06 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26" returned: 0 in 0.558s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:56:06 devstack sudo[105330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.info
Sep 16 08:56:06 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[43454897-046c-40b6-8946-cf9105c69de5]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:06 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:07 devstack sudo[105332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf
Sep 16 08:56:07 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:07 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.info" returned: 0 in 0.370s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:07 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.info is being set with open permissions: ugo+rw
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:07 devstack sudo[105335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.info
Sep 16 08:56:07 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:07 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf" returned: 0 in 0.450s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:07 devstack sudo[105340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26
Sep 16 08:56:07 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:07 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.info" returned: 0 in 0.266s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.523s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:07 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-2f8f9926-de17-42a6-b436-80e4a8bb3b04 tempest-CinderUnicodeTest-1331093156 None] Create snapshot completed successfully
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "cinder-d3683d03-14de-42dd-a0b5-0a20fc612a63-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-d3683d03-14de-42dd-a0b5-0a20fc612a63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "cinder-quobyte-7170b89d-1d91-4b08-ac27-3c42c4fe2739" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-quobyte-7170b89d-1d91-4b08-ac27-3c42c4fe2739" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "cinder-quobyte-d3683d03-14de-42dd-a0b5-0a20fc612a63" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-quobyte-d3683d03-14de-42dd-a0b5-0a20fc612a63" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Deleting offline snapshot d3683d03-14de-42dd-a0b5-0a20fc612a63 of volume 7170b89d-1d91-4b08-ac27-3c42c4fe2739 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] snapshot_file for this snap is: volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:56:07 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26" returned: 0 in 0.430s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff36dad-64fd-4ea7-9146-e2fbff2196ed]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:07 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:07 devstack sudo[105346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26
Sep 16 08:56:07 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:07 devstack sudo[105347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63
Sep 16 08:56:07 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:08 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf.161a0779-6361-404e-b130-3dfc7a2d6f26" returned: 0 in 0.277s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-161a0779-6361-404e-b130-3dfc7a2d6f26" released by "_delete_snapshot" :: held 1.871s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf" released by "delete_snapshot" :: held 1.899s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Created reservations ['6df7acc9-5495-4b57-a9c4-f6f815ff5092', '3707c3b0-d0ed-499b-a192-c8c361644038', '0a301fd7-2d77-49a5-afb0-b1a69942f53e', '7866ce3a-83f6-4c91-a86d-8694d7242c46'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:08 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63" returned: 0 in 0.403s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5141b5e9-fe9d-4f25-ba88-b97b0e4543be]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:08 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Delete snapshot completed successfully.
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-decff30c-8498-4ee8-9a0c-ccbd6e264fb8 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-161a0779-6361-404e-b130-3dfc7a2d6f26-delete_snapshot" released by "delete_snapshot" :: held 2.124s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:08 devstack sudo[105355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739
Sep 16 08:56:08 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Lock "cinder-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6316434-8630-4317-9f50-8ae339a165a5]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:08 devstack sudo[105357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf
Sep 16 08:56:08 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:08 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739" returned: 0 in 0.462s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:08 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63
Sep 16 08:56:08 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:08 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf" returned: 0 in 0.439s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:08 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:09 devstack sudo[105369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf
Sep 16 08:56:09 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:09 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63" returned: 0 in 0.391s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:09 devstack sudo[105372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63
Sep 16 08:56:09 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:09 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf" returned: 0 in 0.303s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf" released by "delete_volume" :: held 0.830s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Created reservations ['8018eb60-3457-4001-a4fd-8a4099ffaf5e', '6213108d-2e86-4c01-9bb0-51a2676daf14', '0dee9e0b-70f2-4ed2-9ae1-0e8dedc3f7f3', 'c09fa280-0914-4c37-9c53-7536ca61eb89'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:09 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739.d3683d03-14de-42dd-a0b5-0a20fc612a63" returned: 0 in 0.281s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-quobyte-d3683d03-14de-42dd-a0b5-0a20fc612a63" released by "_delete_snapshot" :: held 1.687s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-quobyte-7170b89d-1d91-4b08-ac27-3c42c4fe2739" released by "delete_snapshot" :: held 1.716s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:09 devstack sudo[105376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:09 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Created reservations ['1d19718c-dc4d-4385-8e31-eabf451aabd5', '19f1a1db-4da5-4712-ae3b-8c5d27f9f1cd', '1f6d6139-6f74-4982-89e2-6da1dbcc46df', 'e8647737-5983-44ff-826b-216c919f8f9e'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:09 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Delete snapshot completed successfully.
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b6fc46e1-ae2c-4cfb-bfb9-3629cfa9fdde tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-d3683d03-14de-42dd-a0b5-0a20fc612a63-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:09 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.280s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:09 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Deleted volume successfully.
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-837a7798-65bf-47bb-9d61-820e39171dfd tempest-ProjectMemberTests-1200760860 None] Lock "cinder-c950c8e0-12dd-486a-9ee5-cc4efb0c83bf-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "cinder-7170b89d-1d91-4b08-ac27-3c42c4fe2739-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-7170b89d-1d91-4b08-ac27-3c42c4fe2739-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "cinder-quobyte-7170b89d-1d91-4b08-ac27-3c42c4fe2739" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:09 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-quobyte-7170b89d-1d91-4b08-ac27-3c42c4fe2739" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d757d391-2831-47f4-a5de-a8009ce659da]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (7eacd470-b48d-4854-acf8-d335ab5be402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9787796-9b04-4e70-ab08-60c847d50a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9787796-9b04-4e70-ab08-60c847d50a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122424983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238ce8a1-8b33-40de-b888-81d9433e97bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:10Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31cd0ff5-0e74-48a8-b845-469c710a217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31cd0ff5-0e74-48a8-b845-469c710a217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08e7036-fed2-4434-9466-cf2b08300199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08e7036-fed2-4434-9466-cf2b08300199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '238ce8a1-8b33-40de-b888-81d9433e97bf', 'volume_name': 'volume-238ce8a1-8b33-40de-b888-81d9433e97bf', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae03687-bf34-4ac6-b676-05c5bdfbf33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:10 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739
Sep 16 08:56:10 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae03687-bf34-4ac6-b676-05c5bdfbf33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41aa0be-2d4b-4c46-a62e-8a786e940897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:10 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Volume 238ce8a1-8b33-40de-b888-81d9433e97bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-238ce8a1-8b33-40de-b888-81d9433e97bf', 'volume_size': 1}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122424983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238ce8a1-8b33-40de-b888-81d9433e97bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:10Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Creating volume 238ce8a1-8b33-40de-b888-81d9433e97bf {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:10 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:10 devstack sudo[105381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf 1073741824
Sep 16 08:56:10 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:10 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739" returned: 0 in 0.400s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:10 devstack sudo[105389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739
Sep 16 08:56:10 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:10 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf 1073741824" returned: 0 in 0.496s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:10 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7170b89d-1d91-4b08-ac27-3c42c4fe2739" returned: 0 in 0.282s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:10 devstack sudo[105393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf
Sep 16 08:56:10 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-quobyte-7170b89d-1d91-4b08-ac27-3c42c4fe2739" released by "delete_volume" :: held 0.763s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Created reservations ['500a3a04-d33b-4d5e-a70c-7eb56f28f387', '9fcea314-c395-4712-bad6-7cb21bfd8490', 'ae2cf6a2-ad09-4d8f-98df-071848ce596b', '0dcca052-d6ab-414a-95db-2037e958a251'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:10 devstack sudo[105395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:10 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:10 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf" returned: 0 in 0.277s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41aa0be-2d4b-4c46-a62e-8a786e940897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-238ce8a1-8b33-40de-b888-81d9433e97bf', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3265e5b-0b82-400c-aacf-1a54e282b6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:11 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Volume volume-238ce8a1-8b33-40de-b888-81d9433e97bf (238ce8a1-8b33-40de-b888-81d9433e97bf): created successfully
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3265e5b-0b82-400c-aacf-1a54e282b6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (7eacd470-b48d-4854-acf8-d335ab5be402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:11 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4b0960d4-2239-4674-80ec-6d7d71773184 tempest-ProjectMemberTests-1200760860 None] Created volume successfully.
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "cinder-1e874630-30ce-4452-b658-1f8f6ada7084-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:11 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.292s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-1e874630-30ce-4452-b658-1f8f6ada7084-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:11 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Deleted volume successfully.
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b1c18346-f9dc-4581-9e55-edde2a2a2e40 tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-7170b89d-1d91-4b08-ac27-3c42c4fe2739-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "cinder-quobyte-1e874630-30ce-4452-b658-1f8f6ada7084" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-quobyte-1e874630-30ce-4452-b658-1f8f6ada7084" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d06b36-9181-4dad-b508-ea20955614ef]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e874630-30ce-4452-b658-1f8f6ada7084 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:11 devstack sudo[105399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e874630-30ce-4452-b658-1f8f6ada7084
Sep 16 08:56:11 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:11 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e874630-30ce-4452-b658-1f8f6ada7084" returned: 0 in 0.380s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e874630-30ce-4452-b658-1f8f6ada7084 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:11 devstack sudo[105404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e874630-30ce-4452-b658-1f8f6ada7084
Sep 16 08:56:11 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:11 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-1e874630-30ce-4452-b658-1f8f6ada7084" returned: 0 in 0.257s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-quobyte-1e874630-30ce-4452-b658-1f8f6ada7084" released by "delete_volume" :: held 0.699s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Created reservations ['5645f4b2-5285-4037-891c-0562937f1b5d', '16d9fcc1-b926-4344-9bd9-74a7c7a23ecb', '434efd0c-3ebc-4a2b-8df1-d4027cff1716', 'a1523361-0567-417e-bbc9-6ef43ee3ab52'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:12 devstack sudo[105408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:12 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:12 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.286s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:12 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Deleted volume successfully.
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] Creating offline snapshot afa2a762-d1b7-4aa8-9df8-844da5ad46da of volume 238ce8a1-8b33-40de-b888-81d9433e97bf {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4a7f328b-adac-469f-a507-7b02130e0f6d tempest-CinderUnicodeTest-1331093156 None] Lock "cinder-1e874630-30ce-4452-b658-1f8f6ada7084-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37f6500-4da9-40ba-8b8f-f29d50030037]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:12 devstack sudo[105411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf
Sep 16 08:56:12 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:12 devstack sudo[105413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:12 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:12 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf" returned: 0 in 0.476s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:12 devstack sudo[105418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da 1G
Sep 16 08:56:12 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:12 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.341s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:13 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:56:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:56:13 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:56:13 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da 1G" returned: 0 in 0.584s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238ce8a1-8b33-40de-b888-81d9433e97bf -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:13 devstack sudo[105425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238ce8a1-8b33-40de-b888-81d9433e97bf -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da
Sep 16 08:56:13 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:13 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238ce8a1-8b33-40de-b888-81d9433e97bf -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da" returned: 0 in 0.331s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:13 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da is being set with open permissions: ugo+rw
Sep 16 08:56:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:13 devstack sudo[105430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da
Sep 16 08:56:13 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:14 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da" returned: 0 in 0.270s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:14 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.info
Sep 16 08:56:14 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:14 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.info" returned: 0 in 0.270s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:14 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.info is being set with open permissions: ugo+rw
Sep 16 08:56:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:14 devstack sudo[105436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.info
Sep 16 08:56:14 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:14 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.info" returned: 0 in 0.319s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:14 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a7059f6e-84fe-4dfd-8546-229625dbd695 tempest-ProjectMemberTests-1200760860 None] Create snapshot completed successfully
Sep 16 08:56:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-afa2a762-d1b7-4aa8-9df8-844da5ad46da-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Lock "cinder-afa2a762-d1b7-4aa8-9df8-844da5ad46da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-238ce8a1-8b33-40de-b888-81d9433e97bf" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-238ce8a1-8b33-40de-b888-81d9433e97bf" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-afa2a762-d1b7-4aa8-9df8-844da5ad46da" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:15 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-afa2a762-d1b7-4aa8-9df8-844da5ad46da" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Deleting offline snapshot afa2a762-d1b7-4aa8-9df8-844da5ad46da of volume 238ce8a1-8b33-40de-b888-81d9433e97bf {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:56:15 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] snapshot_file for this snap is: volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:56:15 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6dafb6-e6c3-48ce-88af-d447be61ee30]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:15 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:15 devstack sudo[105439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da
Sep 16 08:56:15 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:16 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da" returned: 0 in 0.444s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-238ce8a1-8b33-40de-b888-81d9433e97bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61283af-c737-4d00-9fdb-7cac6d275f1f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:16 devstack sudo[105444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf
Sep 16 08:56:16 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Flow 'volume_create_manager' (2660cdef-4249-4904-a116-a30119db2e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5961289-989e-4a9d-a564-a535f3e2f2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5961289-989e-4a9d-a564-a535f3e2f2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547431177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9955df-5b80-4dee-a9df-6562fc6a9c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa660699874a464085ffc5ae6be63aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:16Z,use_quota=True,user_id='5eebeb8433264e57a5435225ea947bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287463e5-2ca1-4343-833d-f4491b504a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287463e5-2ca1-4343-833d-f4491b504a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2ba8d4-7937-4d41-bd11-1ec71d6396ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2ba8d4-7937-4d41-bd11-1ec71d6396ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba9955df-5b80-4dee-a9df-6562fc6a9c55', 'volume_name': 'volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18adc6c4-b983-4163-986a-98f1926d1b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18adc6c4-b983-4163-986a-98f1926d1b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1d0b1e-3f6f-44d3-8af4-13778dfa2659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:16 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Volume ba9955df-5b80-4dee-a9df-6562fc6a9c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55', 'volume_size': 1}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547431177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9955df-5b80-4dee-a9df-6562fc6a9c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa660699874a464085ffc5ae6be63aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:16Z,use_quota=True,user_id='5eebeb8433264e57a5435225ea947bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Creating volume ba9955df-5b80-4dee-a9df-6562fc6a9c55 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:16 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:16 devstack sudo[105448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55 1073741824
Sep 16 08:56:16 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:16 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf" returned: 0 in 0.455s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:16 devstack sudo[105452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da
Sep 16 08:56:16 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:16 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:16 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55 1073741824" returned: 0 in 0.508s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:16 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da" returned: 0 in 0.401s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:17 devstack sudo[105461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da
Sep 16 08:56:17 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:17 devstack sudo[105463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55
Sep 16 08:56:17 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:17 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf.afa2a762-d1b7-4aa8-9df8-844da5ad46da" returned: 0 in 0.301s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:17 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55" returned: 0 in 0.286s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-afa2a762-d1b7-4aa8-9df8-844da5ad46da" released by "_delete_snapshot" :: held 1.730s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1d0b1e-3f6f-44d3-8af4-13778dfa2659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92aff06a-aa49-484d-933a-9db0713dfb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-238ce8a1-8b33-40de-b888-81d9433e97bf" released by "delete_snapshot" :: held 1.762s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:17 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Volume volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55 (ba9955df-5b80-4dee-a9df-6562fc6a9c55): created successfully
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92aff06a-aa49-484d-933a-9db0713dfb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Flow 'volume_create_manager' (2660cdef-4249-4904-a116-a30119db2e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:17 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-936add5f-291e-4aaa-b501-f8a3605b75a9 tempest-ProjectReaderTests-1349002459 None] Created volume successfully.
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Created reservations ['a6dd5fc0-47bc-4c4e-8313-954a653d6576', '806c4f1a-9a25-4656-bc20-c79cd93a7355', '67c7b822-28c2-4fed-951c-13c29632a77f', 'dc8ff14e-7a25-41bd-8a71-6a5a03d9ea3b'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:17 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Delete snapshot completed successfully.
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-9676b711-d214-4e81-b254-a81de3d05ecd tempest-ProjectMemberTests-1200760860 None] Lock "cinder-afa2a762-d1b7-4aa8-9df8-844da5ad46da-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-238ce8a1-8b33-40de-b888-81d9433e97bf-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-238ce8a1-8b33-40de-b888-81d9433e97bf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-238ce8a1-8b33-40de-b888-81d9433e97bf" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-238ce8a1-8b33-40de-b888-81d9433e97bf" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[227b32b1-8ea3-49bb-a9f0-ba9f043dcae9]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:17 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:17 devstack sudo[105467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf
Sep 16 08:56:17 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:18 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf" returned: 0 in 0.388s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:18 devstack sudo[105472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf
Sep 16 08:56:18 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:18 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-238ce8a1-8b33-40de-b888-81d9433e97bf" returned: 0 in 0.272s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-238ce8a1-8b33-40de-b888-81d9433e97bf" released by "delete_volume" :: held 0.736s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Created reservations ['35fcbd0a-481a-496b-a16d-936719744119', 'f70c566a-7197-455b-ae73-642fab7a96e0', '6dfd1863-a0a5-4d4d-b609-3f214573d087', 'c83e5707-703b-4182-ba11-f7cbe792e918'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] Creating offline snapshot 6a0e58c2-2015-43c4-a749-67ee5eadfde6 of volume ba9955df-5b80-4dee-a9df-6562fc6a9c55 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d267d1-8068-43e7-a279-5c59f79ebaaa]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:18 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:18 devstack sudo[105475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:18 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:18 devstack sudo[105476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55
Sep 16 08:56:18 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:19 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.314s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:19 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Deleted volume successfully.
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-d647cb5e-ae83-40fb-975e-3b9dca7ad627 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-238ce8a1-8b33-40de-b888-81d9433e97bf-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:19 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55" returned: 0 in 0.502s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:19 devstack sudo[105483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6 1G
Sep 16 08:56:19 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (28c0e709-b932-44dd-ad45-df4d047f8c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254d284b-c6d7-48bd-b715-0e692f231f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254d284b-c6d7-48bd-b715-0e692f231f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305750514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c70819-efc8-48de-9609-2104b6d859bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:19Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089154cd-1cbd-42eb-bcc2-0a1d5bfeb377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089154cd-1cbd-42eb-bcc2-0a1d5bfeb377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0973376-7bf5-4506-a02b-cb0edcda81bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0973376-7bf5-4506-a02b-cb0edcda81bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c70819-efc8-48de-9609-2104b6d859bd', 'volume_name': 'volume-67c70819-efc8-48de-9609-2104b6d859bd', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e390f1f8-f4c4-4d75-a1ee-412e9dc5034b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e390f1f8-f4c4-4d75-a1ee-412e9dc5034b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0c3030-4862-48e7-828c-f674bd9dafb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:19 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Volume 67c70819-efc8-48de-9609-2104b6d859bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c70819-efc8-48de-9609-2104b6d859bd', 'volume_size': 1}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:19 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6 1G" returned: 0 in 0.535s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:19 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:19 devstack sudo[105489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6
Sep 16 08:56:19 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:20 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6" returned: 0 in 0.315s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:20 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6 is being set with open permissions: ugo+rw
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:20 devstack sudo[105494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6
Sep 16 08:56:20 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:20 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6" returned: 0 in 0.258s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:20 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.info
Sep 16 08:56:20 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:20 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.info" returned: 0 in 0.269s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:20 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.info is being set with open permissions: ugo+rw
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:20 devstack sudo[105500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.info
Sep 16 08:56:20 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:20 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.info" returned: 0 in 0.259s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305750514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c70819-efc8-48de-9609-2104b6d859bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:19Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Creating volume 67c70819-efc8-48de-9609-2104b6d859bd {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:20 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:21 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:21 devstack sudo[105503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd 1073741824
Sep 16 08:56:21 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:21 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-6a9251ac-f88c-49da-8dae-d202658a8b5a tempest-ProjectReaderTests-1349002459 None] Create snapshot completed successfully
Sep 16 08:56:21 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd 1073741824" returned: 0 in 0.487s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:21 devstack sudo[105509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd
Sep 16 08:56:21 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:21 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd" returned: 0 in 0.274s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0c3030-4862-48e7-828c-f674bd9dafb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c70819-efc8-48de-9609-2104b6d859bd', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89797dfd-b100-4afe-ac89-26b62d266f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:21 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Volume volume-67c70819-efc8-48de-9609-2104b6d859bd (67c70819-efc8-48de-9609-2104b6d859bd): created successfully
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89797dfd-b100-4afe-ac89-26b62d266f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:21 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (28c0e709-b932-44dd-ad45-df4d047f8c7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:21 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-9ac906c3-da90-4bcb-ad38-9f332748f168 tempest-ProjectMemberTests-1200760860 None] Created volume successfully.
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-6a0e58c2-2015-43c4-a749-67ee5eadfde6-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-6a0e58c2-2015-43c4-a749-67ee5eadfde6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-ba9955df-5b80-4dee-a9df-6562fc6a9c55" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-ba9955df-5b80-4dee-a9df-6562fc6a9c55" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-6a0e58c2-2015-43c4-a749-67ee5eadfde6" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-6a0e58c2-2015-43c4-a749-67ee5eadfde6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Deleting offline snapshot 6a0e58c2-2015-43c4-a749-67ee5eadfde6 of volume ba9955df-5b80-4dee-a9df-6562fc6a9c55 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] snapshot_file for this snap is: volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb467e0-060c-4076-9cfa-0339e19d6201]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:22 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6
Sep 16 08:56:22 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:22 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6" returned: 0 in 0.416s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4e1d6a-5061-47b7-a781-34b6b27d71b0]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:22 devstack sudo[105518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55
Sep 16 08:56:22 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] Creating offline snapshot 7cdd6867-1f02-4f8e-9535-5ada9b3778c2 of volume 67c70819-efc8-48de-9609-2104b6d859bd {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc8836d-8bf1-4f3c-bb01-7486ad2a019d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:22 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:23 devstack sudo[105520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd
Sep 16 08:56:23 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:23 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55" returned: 0 in 0.418s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:23 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6
Sep 16 08:56:23 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:23 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd" returned: 0 in 0.408s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:23 devstack sudo[105533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2 1G
Sep 16 08:56:23 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:23 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6" returned: 0 in 0.427s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:23 devstack sudo[105536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6
Sep 16 08:56:23 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:23 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:23 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2 1G" returned: 0 in 0.479s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67c70819-efc8-48de-9609-2104b6d859bd -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:23 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55.6a0e58c2-2015-43c4-a749-67ee5eadfde6" returned: 0 in 0.319s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:23 devstack sudo[105544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67c70819-efc8-48de-9609-2104b6d859bd -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2
Sep 16 08:56:23 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-6a0e58c2-2015-43c4-a749-67ee5eadfde6" released by "_delete_snapshot" :: held 1.716s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:23 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-ba9955df-5b80-4dee-a9df-6562fc6a9c55" released by "delete_snapshot" :: held 1.741s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:23 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Created reservations ['df3437e1-2f91-4b7a-bf65-8b947f7e3adb', '827c56a6-e53d-4e07-881e-3bf564a0caf2', '07cf33d7-16d4-4b90-a0f4-3be59c255eed', 'e1c185f6-f600-4ef9-9cf1-ed34cde20072'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:24 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Delete snapshot completed successfully.
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-68a8045f-5578-429e-b9dc-a4d1de0cbd74 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-6a0e58c2-2015-43c4-a749-67ee5eadfde6-delete_snapshot" released by "delete_snapshot" :: held 1.898s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:24 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67c70819-efc8-48de-9609-2104b6d859bd -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2" returned: 0 in 0.332s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:24 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2 is being set with open permissions: ugo+rw
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:24 devstack sudo[105549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2
Sep 16 08:56:24 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-ba9955df-5b80-4dee-a9df-6562fc6a9c55-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Lock "cinder-ba9955df-5b80-4dee-a9df-6562fc6a9c55-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-ba9955df-5b80-4dee-a9df-6562fc6a9c55" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-ba9955df-5b80-4dee-a9df-6562fc6a9c55" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:24 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2" returned: 0 in 0.287s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c12142-ca91-4e0f-b14c-349c0199fa00]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:24 devstack sudo[105553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.info
Sep 16 08:56:24 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:24 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55
Sep 16 08:56:24 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:24 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.info" returned: 0 in 0.285s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:24 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.info is being set with open permissions: ugo+rw
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:24 devstack sudo[105557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.info
Sep 16 08:56:24 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:24 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55" returned: 0 in 0.437s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:24 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:24 devstack sudo[105562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55
Sep 16 08:56:24 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:25 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.info" returned: 0 in 0.294s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:25 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f06ebfb0-f31a-4637-a110-378dd786526f tempest-ProjectMemberTests-1200760860 None] Create snapshot completed successfully
Sep 16 08:56:25 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ba9955df-5b80-4dee-a9df-6562fc6a9c55" returned: 0 in 0.271s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-ba9955df-5b80-4dee-a9df-6562fc6a9c55" released by "delete_volume" :: held 0.778s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Created reservations ['731a8f89-0336-42dd-9d03-e91930b7cb84', '6e003cdd-843d-4965-926f-11449619b969', '3e6f0ca0-811f-427e-8754-8b82fc49e27d', '003dbc77-0dbe-40f7-9224-ed714bac78bd'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:25 devstack sudo[105566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:25 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:25 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.261s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:25 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Deleted volume successfully.
Sep 16 08:56:25 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-b7c8c98a-ce15-4d00-b91e-e0969b47c7ae tempest-ProjectReaderTests-1349002459 None] Lock "cinder-ba9955df-5b80-4dee-a9df-6562fc6a9c55-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Flow 'volume_create_manager' (90e1496c-ebe2-4655-aa9a-db98adeba632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5837a3c-9b67-47d2-8c54-8a6d8b2d2289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5837a3c-9b67-47d2-8c54-8a6d8b2d2289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1143129706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58148f93-e3dc-40c7-8a8d-f83136383ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa660699874a464085ffc5ae6be63aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:26Z,use_quota=True,user_id='5eebeb8433264e57a5435225ea947bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c131b7-75fb-41d1-a321-2c23a47d8239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c131b7-75fb-41d1-a321-2c23a47d8239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585f767b-343f-40cb-b247-6b795b903db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585f767b-343f-40cb-b247-6b795b903db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58148f93-e3dc-40c7-8a8d-f83136383ed3', 'volume_name': 'volume-58148f93-e3dc-40c7-8a8d-f83136383ed3', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee95d76-9a36-45ff-a55c-5eb5769d108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee95d76-9a36-45ff-a55c-5eb5769d108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280d8cae-d1da-4f46-8e5b-00b25dfa5232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:26 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Volume 58148f93-e3dc-40c7-8a8d-f83136383ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58148f93-e3dc-40c7-8a8d-f83136383ed3', 'volume_size': 1}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1143129706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58148f93-e3dc-40c7-8a8d-f83136383ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa660699874a464085ffc5ae6be63aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:26Z,use_quota=True,user_id='5eebeb8433264e57a5435225ea947bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Creating volume 58148f93-e3dc-40c7-8a8d-f83136383ed3 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:26 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-7cdd6867-1f02-4f8e-9535-5ada9b3778c2-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:26 devstack sudo[105569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3 1073741824
Sep 16 08:56:26 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-7cdd6867-1f02-4f8e-9535-5ada9b3778c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-67c70819-efc8-48de-9609-2104b6d859bd" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-67c70819-efc8-48de-9609-2104b6d859bd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-7cdd6867-1f02-4f8e-9535-5ada9b3778c2" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-7cdd6867-1f02-4f8e-9535-5ada9b3778c2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Deleting offline snapshot 7cdd6867-1f02-4f8e-9535-5ada9b3778c2 of volume 67c70819-efc8-48de-9609-2104b6d859bd {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] snapshot_file for this snap is: volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b073a9e-6fdf-49b2-9409-d6157f79e549]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:26 devstack sudo[105571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2
Sep 16 08:56:26 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:26 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3 1073741824" returned: 0 in 0.541s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:26 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2" returned: 0 in 0.462s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67c70819-efc8-48de-9609-2104b6d859bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a84ba5-fca0-4c38-b8df-bd2422382d61]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:26 devstack sudo[105580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3
Sep 16 08:56:26 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:26 devstack sudo[105581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd
Sep 16 08:56:26 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:27 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3" returned: 0 in 0.298s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280d8cae-d1da-4f46-8e5b-00b25dfa5232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58148f93-e3dc-40c7-8a8d-f83136383ed3', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbf5eee-8fe5-4f97-9ffe-5fbe48181cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:27 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Volume volume-58148f93-e3dc-40c7-8a8d-f83136383ed3 (58148f93-e3dc-40c7-8a8d-f83136383ed3): created successfully
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbf5eee-8fe5-4f97-9ffe-5fbe48181cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Flow 'volume_create_manager' (90e1496c-ebe2-4655-aa9a-db98adeba632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:27 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0db41d04-564d-40d3-b498-1340d894f21a tempest-ProjectReaderTests-1349002459 None] Created volume successfully.
Sep 16 08:56:27 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd" returned: 0 in 0.432s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:27 devstack sudo[105588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2
Sep 16 08:56:27 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:27 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2" returned: 0 in 0.373s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:27 devstack sudo[105593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2
Sep 16 08:56:27 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:27 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd.7cdd6867-1f02-4f8e-9535-5ada9b3778c2" returned: 0 in 0.267s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-7cdd6867-1f02-4f8e-9535-5ada9b3778c2" released by "_delete_snapshot" :: held 1.684s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-67c70819-efc8-48de-9609-2104b6d859bd" released by "delete_snapshot" :: held 1.708s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:27 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Created reservations ['9bd80462-7cfa-4ea2-afd1-fd8188f1a674', 'c4b58cc3-cfc5-419c-9bfc-e23a7a04eecd', '21fd9a3d-9e6d-4838-9a39-4f7a5b0532c2', 'bba6b8ae-7992-4692-965e-23d6c047af8d'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:28 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Delete snapshot completed successfully.
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-857f6227-7620-4d1a-a495-aa2677dcde36 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-7cdd6867-1f02-4f8e-9535-5ada9b3778c2-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] Creating offline snapshot 594b3502-35a2-46df-bded-d6c048697420 of volume 58148f93-e3dc-40c7-8a8d-f83136383ed3 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e506159f-d5b0-471e-8cf3-6b210f2c69d9]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-67c70819-efc8-48de-9609-2104b6d859bd-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Lock "cinder-67c70819-efc8-48de-9609-2104b6d859bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-67c70819-efc8-48de-9609-2104b6d859bd" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-67c70819-efc8-48de-9609-2104b6d859bd" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:28 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3
Sep 16 08:56:28 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[874f5f9e-5f64-4e66-a6dd-dd4265427959]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:28 devstack sudo[105598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd
Sep 16 08:56:28 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:28 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3" returned: 0 in 0.459s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:28 devstack sudo[105604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420 1G
Sep 16 08:56:28 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:28 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd" returned: 0 in 0.473s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:29 devstack sudo[105609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd
Sep 16 08:56:29 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:29 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-67c70819-efc8-48de-9609-2104b6d859bd" returned: 0 in 0.300s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-67c70819-efc8-48de-9609-2104b6d859bd" released by "delete_volume" :: held 0.874s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:29 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420 1G" returned: 0 in 0.539s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58148f93-e3dc-40c7-8a8d-f83136383ed3 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:29 devstack sudo[105616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58148f93-e3dc-40c7-8a8d-f83136383ed3 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420
Sep 16 08:56:29 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Created reservations ['5f9b20b7-17c5-483a-a5a6-f40e6d4293a6', '5fb7e1d9-718c-44fa-88fc-93fefab2c270', 'a682adb7-4125-48a0-b067-2600c187a578', 'd948a987-4b1c-46e4-abb4-a8e04635b3e5'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:29 devstack sudo[105618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:29 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:29 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58148f93-e3dc-40c7-8a8d-f83136383ed3 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420" returned: 0 in 0.380s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:29 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420 is being set with open permissions: ugo+rw
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:29 devstack sudo[105623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420
Sep 16 08:56:29 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:29 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.359s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:29 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Deleted volume successfully.
Sep 16 08:56:29 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-e0c1ac56-588c-42a0-b70e-dbc75a07c2ec tempest-ProjectMemberTests-1200760860 None] Lock "cinder-67c70819-efc8-48de-9609-2104b6d859bd-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:30 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420" returned: 0 in 0.306s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:30 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.info
Sep 16 08:56:30 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (26b4c16f-48ab-492f-ad27-0525d81f3451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba13f1be-2a86-4e68-8027-ce8881a5ca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba13f1be-2a86-4e68-8027-ce8881a5ca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993219967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187ce210-f491-42e3-b4c2-deea8a549ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:30Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bfc835-9612-4c1b-8e5f-8e127ab5711e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bfc835-9612-4c1b-8e5f-8e127ab5711e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0384d8-d07f-4c93-a251-870d77db4c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0384d8-d07f-4c93-a251-870d77db4c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '187ce210-f491-42e3-b4c2-deea8a549ba9', 'volume_name': 'volume-187ce210-f491-42e3-b4c2-deea8a549ba9', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cb7c50-16a3-4c25-b90b-bb3812f027f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cb7c50-16a3-4c25-b90b-bb3812f027f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3558c546-c3eb-4320-b6ae-42809be467dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:30 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Volume 187ce210-f491-42e3-b4c2-deea8a549ba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-187ce210-f491-42e3-b4c2-deea8a549ba9', 'volume_size': 1}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:30 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.info" returned: 0 in 0.294s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:30 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.info is being set with open permissions: ugo+rw
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:30 devstack sudo[105630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.info
Sep 16 08:56:30 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:30 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.info" returned: 0 in 0.254s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993219967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187ce210-f491-42e3-b4c2-deea8a549ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:30Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Creating volume 187ce210-f491-42e3-b4c2-deea8a549ba9 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:30 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:30 devstack sudo[105633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9 1073741824
Sep 16 08:56:30 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-118140f8-171c-41b7-9eb5-171368cb3c56 tempest-ProjectReaderTests-1349002459 None] Create snapshot completed successfully
Sep 16 08:56:31 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9 1073741824" returned: 0 in 0.508s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:31 devstack sudo[105639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9
Sep 16 08:56:31 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:31 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9" returned: 0 in 0.283s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3558c546-c3eb-4320-b6ae-42809be467dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-187ce210-f491-42e3-b4c2-deea8a549ba9', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ef26dd-fafc-46d6-8fc2-a23ce46af0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-594b3502-35a2-46df-bded-d6c048697420-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:31 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Volume volume-187ce210-f491-42e3-b4c2-deea8a549ba9 (187ce210-f491-42e3-b4c2-deea8a549ba9): created successfully
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ef26dd-fafc-46d6-8fc2-a23ce46af0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (26b4c16f-48ab-492f-ad27-0525d81f3451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Lock "cinder-594b3502-35a2-46df-bded-d6c048697420-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-58148f93-e3dc-40c7-8a8d-f83136383ed3" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:31 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-64660c79-b170-44de-bb0f-29869781b03b tempest-ProjectMemberTests-1200760860 None] Created volume successfully.
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-58148f93-e3dc-40c7-8a8d-f83136383ed3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-594b3502-35a2-46df-bded-d6c048697420" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-594b3502-35a2-46df-bded-d6c048697420" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Deleting offline snapshot 594b3502-35a2-46df-bded-d6c048697420 of volume 58148f93-e3dc-40c7-8a8d-f83136383ed3 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] snapshot_file for this snap is: volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caa171b-e497-4a3a-9d16-0f10eb91c4e7]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:31 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:31 devstack sudo[105642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420
Sep 16 08:56:31 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:32 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420" returned: 0 in 0.416s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58148f93-e3dc-40c7-8a8d-f83136383ed3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d8608f-c5d7-4c9f-be9d-926a626cecfd]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:32 devstack sudo[105648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3
Sep 16 08:56:32 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] Creating offline snapshot 1185d1c3-7a1e-4505-a732-f872f7984a93 of volume 187ce210-f491-42e3-b4c2-deea8a549ba9 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4780785a-6c4d-4fd7-a588-410688f295b1]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:32 devstack sudo[105650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9
Sep 16 08:56:32 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:32 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3" returned: 0 in 0.382s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:32 devstack sudo[105655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420
Sep 16 08:56:32 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:32 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9" returned: 0 in 0.405s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:32 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93 1G
Sep 16 08:56:32 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:32 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420" returned: 0 in 0.370s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:32 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:32 devstack sudo[105665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420
Sep 16 08:56:32 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:33 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3.594b3502-35a2-46df-bded-d6c048697420" returned: 0 in 0.272s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:33 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93 1G" returned: 0 in 0.403s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-187ce210-f491-42e3-b4c2-deea8a549ba9 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-594b3502-35a2-46df-bded-d6c048697420" released by "_delete_snapshot" :: held 1.568s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-58148f93-e3dc-40c7-8a8d-f83136383ed3" released by "delete_snapshot" :: held 1.602s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:33 devstack sudo[105672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-187ce210-f491-42e3-b4c2-deea8a549ba9 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93
Sep 16 08:56:33 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Created reservations ['d56df6ea-ddf1-4ee1-a327-f2a711b22b02', 'd3128e88-d702-4318-b159-0f3aaa3fdede', 'b01140b6-f1de-4b0a-9d6d-8e9a733d52ff', '1d3b3662-825e-4e5e-be70-9ee0cc3672d5'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:33 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Delete snapshot completed successfully.
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0f2e9c54-b6e8-454d-b1b5-8e2adbfd9ffb tempest-ProjectReaderTests-1349002459 None] Lock "cinder-594b3502-35a2-46df-bded-d6c048697420-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:33 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-187ce210-f491-42e3-b4c2-deea8a549ba9 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93" returned: 0 in 0.297s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:33 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93 is being set with open permissions: ugo+rw
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:33 devstack sudo[105677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93
Sep 16 08:56:33 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-58148f93-e3dc-40c7-8a8d-f83136383ed3-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Lock "cinder-58148f93-e3dc-40c7-8a8d-f83136383ed3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-58148f93-e3dc-40c7-8a8d-f83136383ed3" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:33 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93" returned: 0 in 0.276s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-58148f93-e3dc-40c7-8a8d-f83136383ed3" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[918cf840-319b-455a-8ecf-4ef000ddad89]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:33 devstack sudo[105680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.info
Sep 16 08:56:33 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:33 devstack sudo[105681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3
Sep 16 08:56:33 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:34 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.info" returned: 0 in 0.269s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:34 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.info is being set with open permissions: ugo+rw
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:34 devstack sudo[105685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.info
Sep 16 08:56:34 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:34 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3" returned: 0 in 0.372s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:34 devstack sudo[105690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3
Sep 16 08:56:34 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:34 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.info" returned: 0 in 0.253s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-394cdaa4-5843-4058-a4c4-c30122c940c6 tempest-ProjectMemberTests-1200760860 None] Create snapshot completed successfully
Sep 16 08:56:34 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-58148f93-e3dc-40c7-8a8d-f83136383ed3" returned: 0 in 0.259s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-58148f93-e3dc-40c7-8a8d-f83136383ed3" released by "delete_volume" :: held 0.703s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Created reservations ['451eb909-f4f0-4be7-940a-bbf554032d5a', 'ca554071-d3eb-471a-ae88-6e608be653db', '0878c1f8-6f21-4dcd-95ea-0457e979de73', '69d2cc4a-db76-4c4f-b725-f750c56772a2'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:34 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:34 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:34 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.257s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Deleted volume successfully.
Sep 16 08:56:34 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ed70367a-dc95-4bc3-a4f1-b7e92b9e1b3f tempest-ProjectReaderTests-1349002459 None] Lock "cinder-58148f93-e3dc-40c7-8a8d-f83136383ed3-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Flow 'volume_create_manager' (439a9da0-5fa6-4faf-a661-089dbbf5bf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967029bf-ce7f-4d10-ace3-6dd03491996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967029bf-ce7f-4d10-ace3-6dd03491996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677853134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97ac016-6b34-4116-80fd-736ee1b01999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa660699874a464085ffc5ae6be63aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:35Z,use_quota=True,user_id='5eebeb8433264e57a5435225ea947bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb081c4-5fb8-4425-ac15-064d03162cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb081c4-5fb8-4425-ac15-064d03162cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa91ee78-db0a-477b-ad9b-061cd88f9580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa91ee78-db0a-477b-ad9b-061cd88f9580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd97ac016-6b34-4116-80fd-736ee1b01999', 'volume_name': 'volume-d97ac016-6b34-4116-80fd-736ee1b01999', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a3c5db-cbd1-4182-9f3a-38de96234feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a3c5db-cbd1-4182-9f3a-38de96234feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5811822a-03e4-456f-a101-72683d7e8278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:35 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Volume d97ac016-6b34-4116-80fd-736ee1b01999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d97ac016-6b34-4116-80fd-736ee1b01999', 'volume_size': 1}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677853134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97ac016-6b34-4116-80fd-736ee1b01999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa660699874a464085ffc5ae6be63aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:35Z,use_quota=True,user_id='5eebeb8433264e57a5435225ea947bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Creating volume d97ac016-6b34-4116-80fd-736ee1b01999 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:35 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:35 devstack sudo[105697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999 1073741824
Sep 16 08:56:35 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-1185d1c3-7a1e-4505-a732-f872f7984a93-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Lock "cinder-1185d1c3-7a1e-4505-a732-f872f7984a93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-187ce210-f491-42e3-b4c2-deea8a549ba9" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-187ce210-f491-42e3-b4c2-deea8a549ba9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-1185d1c3-7a1e-4505-a732-f872f7984a93" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-1185d1c3-7a1e-4505-a732-f872f7984a93" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Deleting offline snapshot 1185d1c3-7a1e-4505-a732-f872f7984a93 of volume 187ce210-f491-42e3-b4c2-deea8a549ba9 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] snapshot_file for this snap is: volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c073d14c-7a2a-4be9-8105-d5f2aecb1419]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:35 devstack sudo[105700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93
Sep 16 08:56:35 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:35 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999 1073741824" returned: 0 in 0.455s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:35 devstack sudo[105705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999
Sep 16 08:56:35 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:35 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93" returned: 0 in 0.395s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-187ce210-f491-42e3-b4c2-deea8a549ba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67ff196-1d94-4ec3-b7ee-acaed8fbc379]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:36 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999" returned: 0 in 0.265s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5811822a-03e4-456f-a101-72683d7e8278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97ac016-6b34-4116-80fd-736ee1b01999', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:36 devstack sudo[105710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78d11b3-0a22-4f26-b1f4-25a7d747fa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:36 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:36 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Volume volume-d97ac016-6b34-4116-80fd-736ee1b01999 (d97ac016-6b34-4116-80fd-736ee1b01999): created successfully
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78d11b3-0a22-4f26-b1f4-25a7d747fa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Flow 'volume_create_manager' (439a9da0-5fa6-4faf-a661-089dbbf5bf49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:36 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0342a997-44e8-4c43-9c6b-ed10c600664d tempest-ProjectReaderTests-1349002459 None] Created volume successfully.
Sep 16 08:56:36 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9" returned: 0 in 0.377s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:36 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93
Sep 16 08:56:36 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] Creating offline snapshot 2354c9ed-51ec-4239-9e42-9946d61da70d of volume d97ac016-6b34-4116-80fd-736ee1b01999 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08803d0-4f96-4ca1-b7ac-384cf3fca8bc]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:36 devstack sudo[105718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999
Sep 16 08:56:36 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:36 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93" returned: 0 in 0.343s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:36 devstack sudo[105723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93
Sep 16 08:56:36 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:36 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999" returned: 0 in 0.387s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:36 devstack sudo[105729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d 1G
Sep 16 08:56:36 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:37 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9.1185d1c3-7a1e-4505-a732-f872f7984a93" returned: 0 in 0.261s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-1185d1c3-7a1e-4505-a732-f872f7984a93" released by "_delete_snapshot" :: held 1.502s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-187ce210-f491-42e3-b4c2-deea8a549ba9" released by "delete_snapshot" :: held 1.527s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Created reservations ['cf614edd-6af3-43bb-85c9-e97c5845a98a', 'b86716f6-2f4b-4dcc-8402-daba646f1a43', 'b0f21c4d-0cde-411a-b9e6-c65be6e46b00', '9a96e4a4-3055-417e-ba6e-20e0ecdb68ba'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Delete snapshot completed successfully.
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-1c4568ae-35fb-472d-a22f-ee86147c402c tempest-ProjectMemberTests-1200760860 None] Lock "cinder-1185d1c3-7a1e-4505-a732-f872f7984a93-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:37 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d 1G" returned: 0 in 0.417s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d97ac016-6b34-4116-80fd-736ee1b01999 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:37 devstack sudo[105735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d97ac016-6b34-4116-80fd-736ee1b01999 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d
Sep 16 08:56:37 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:37 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d97ac016-6b34-4116-80fd-736ee1b01999 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d" returned: 0 in 0.296s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:37 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d is being set with open permissions: ugo+rw
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:37 devstack sudo[105740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d
Sep 16 08:56:37 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-187ce210-f491-42e3-b4c2-deea8a549ba9-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Lock "cinder-187ce210-f491-42e3-b4c2-deea8a549ba9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-187ce210-f491-42e3-b4c2-deea8a549ba9" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-187ce210-f491-42e3-b4c2-deea8a549ba9" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[244251c1-869b-4b5e-a481-86a68c14638e]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:37 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d" returned: 0 in 0.260s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:37 devstack sudo[105744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.info
Sep 16 08:56:37 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:37 devstack sudo[105742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9
Sep 16 08:56:37 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:38 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.info" returned: 0 in 0.268s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:38 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.info is being set with open permissions: ugo+rw
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:38 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9" returned: 0 in 0.381s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:38 devstack sudo[105751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.info
Sep 16 08:56:38 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:38 devstack sudo[105752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9
Sep 16 08:56:38 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:38 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.info" returned: 0 in 0.256s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:38 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-187ce210-f491-42e3-b4c2-deea8a549ba9" returned: 0 in 0.259s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-187ce210-f491-42e3-b4c2-deea8a549ba9" released by "delete_volume" :: held 0.708s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1bda36ac-7a9f-4326-8059-cbc0644fae3f tempest-ProjectReaderTests-1349002459 None] Create snapshot completed successfully
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Created reservations ['9f19df5f-c6dc-45e0-94ae-dcd602fb291b', '2bf5598c-48e1-4cb7-888c-a924818fd6eb', 'ac44ef6f-0e83-4fa7-9286-660364d6741e', 'c717ad42-519b-425c-938c-40e192893f99'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:38 devstack sudo[105757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:38 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:38 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.263s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:38 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Deleted volume successfully.
Sep 16 08:56:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-f8112722-f8c6-4195-a0ad-d56817e7631b tempest-ProjectMemberTests-1200760860 None] Lock "cinder-187ce210-f491-42e3-b4c2-deea8a549ba9-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (4bc5fd49-5435-488f-81b8-6396225a7af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e652f8-8916-42b5-ba03-acd641f44863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e652f8-8916-42b5-ba03-acd641f44863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471496530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457c3be7-fa9a-44e9-90ec-05a320731d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:39Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faaf864c-73da-4834-9969-9cd2a933dfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faaf864c-73da-4834-9969-9cd2a933dfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d6e054-4e94-48a7-a6d9-25e7ca77f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d6e054-4e94-48a7-a6d9-25e7ca77f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '457c3be7-fa9a-44e9-90ec-05a320731d61', 'volume_name': 'volume-457c3be7-fa9a-44e9-90ec-05a320731d61', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be463499-f200-4521-935b-f9151506679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be463499-f200-4521-935b-f9151506679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8c8cd5-8c1b-4ca8-8208-591eaa0480a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:39 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Volume 457c3be7-fa9a-44e9-90ec-05a320731d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-457c3be7-fa9a-44e9-90ec-05a320731d61', 'volume_size': 1}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471496530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457c3be7-fa9a-44e9-90ec-05a320731d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:39Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Creating volume 457c3be7-fa9a-44e9-90ec-05a320731d61 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:39 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:39 devstack sudo[105760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61 1073741824
Sep 16 08:56:39 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-2354c9ed-51ec-4239-9e42-9946d61da70d-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-2354c9ed-51ec-4239-9e42-9946d61da70d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-d97ac016-6b34-4116-80fd-736ee1b01999" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-d97ac016-6b34-4116-80fd-736ee1b01999" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-2354c9ed-51ec-4239-9e42-9946d61da70d" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-2354c9ed-51ec-4239-9e42-9946d61da70d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Deleting offline snapshot 2354c9ed-51ec-4239-9e42-9946d61da70d of volume d97ac016-6b34-4116-80fd-736ee1b01999 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] snapshot_file for this snap is: volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6d9c2d-a36b-41e3-a001-345279c8d837]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:39 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61 1073741824" returned: 0 in 0.499s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:39 devstack sudo[105767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d
Sep 16 08:56:39 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:39 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61
Sep 16 08:56:39 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:40 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d" returned: 0 in 0.387s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d97ac016-6b34-4116-80fd-736ee1b01999(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:56:40 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61" returned: 0 in 0.271s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8c8cd5-8c1b-4ca8-8208-591eaa0480a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-457c3be7-fa9a-44e9-90ec-05a320731d61', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161cb680-8d11-4359-9c8d-54307429dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a60a9c-2dce-4763-9377-5f0b62b8c9b4]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:40 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Volume volume-457c3be7-fa9a-44e9-90ec-05a320731d61 (457c3be7-fa9a-44e9-90ec-05a320731d61): created successfully
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161cb680-8d11-4359-9c8d-54307429dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (4bc5fd49-5435-488f-81b8-6396225a7af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:40 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7cdf2bd8-1450-4064-8bea-0caaa441e29e tempest-ProjectMemberTests-1200760860 None] Created volume successfully.
Sep 16 08:56:40 devstack sudo[105775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999
Sep 16 08:56:40 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:40 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999" returned: 0 in 0.361s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:40 devstack sudo[105780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d
Sep 16 08:56:40 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:40 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d" returned: 0 in 0.330s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:40 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:40 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d
Sep 16 08:56:40 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:41 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999.2354c9ed-51ec-4239-9e42-9946d61da70d" returned: 0 in 0.251s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-2354c9ed-51ec-4239-9e42-9946d61da70d" released by "_delete_snapshot" :: held 1.450s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-d97ac016-6b34-4116-80fd-736ee1b01999" released by "delete_snapshot" :: held 1.475s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Created reservations ['ea3a202c-5726-4712-983b-e007be545ffb', 'bd232d18-5df5-411c-8b56-b4f563a4745b', '09b8f9db-4760-4b3a-a245-1f549fafab29', 'd8f13730-4621-4bff-8522-bef3e6d3c0c1'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:41 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Delete snapshot completed successfully.
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-7988835f-4379-4fa5-9137-f26325bc4038 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-2354c9ed-51ec-4239-9e42-9946d61da70d-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] Creating offline snapshot bcb90fd8-b08e-493b-a5dc-fda7fe345a45 of volume 457c3be7-fa9a-44e9-90ec-05a320731d61 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24afebe-a5f8-459b-93af-b7cf71532360]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:41 devstack sudo[105788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61
Sep 16 08:56:41 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-d97ac016-6b34-4116-80fd-736ee1b01999-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Lock "cinder-d97ac016-6b34-4116-80fd-736ee1b01999-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-d97ac016-6b34-4116-80fd-736ee1b01999" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-d97ac016-6b34-4116-80fd-736ee1b01999" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2e201d-2c24-42d9-96aa-345a73063963]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:41 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61" returned: 0 in 0.410s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:41 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:41 devstack sudo[105795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45 1G
Sep 16 08:56:41 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:42 devstack sudo[105794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999
Sep 16 08:56:42 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:42 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999" returned: 0 in 0.390s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:42 devstack sudo[105804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999
Sep 16 08:56:42 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:42 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45 1G" returned: 0 in 0.415s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-457c3be7-fa9a-44e9-90ec-05a320731d61 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:42 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-457c3be7-fa9a-44e9-90ec-05a320731d61 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45
Sep 16 08:56:42 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:42 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-d97ac016-6b34-4116-80fd-736ee1b01999" returned: 0 in 0.256s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-d97ac016-6b34-4116-80fd-736ee1b01999" released by "delete_volume" :: held 0.715s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Created reservations ['563c3617-1e64-425a-a909-37935d57086c', '4bc96913-3508-4ff6-a137-e08326c8de4c', 'eb8a3da0-4aa1-45d6-832e-54f8c07786d5', 'dc21aaf6-c48f-4692-90d6-db44612ed74e'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:42 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-457c3be7-fa9a-44e9-90ec-05a320731d61 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45" returned: 0 in 0.299s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:42 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45 is being set with open permissions: ugo+rw
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:42 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45
Sep 16 08:56:42 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:42 devstack sudo[105814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:42 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:42 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45" returned: 0 in 0.258s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:42 devstack sudo[105817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.info
Sep 16 08:56:42 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:43 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.281s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:43 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Deleted volume successfully.
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-26f27014-3806-49cb-ae61-44a86dc86d8e tempest-ProjectReaderTests-1349002459 None] Lock "cinder-d97ac016-6b34-4116-80fd-736ee1b01999-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:43 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.info" returned: 0 in 0.286s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:43 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.info is being set with open permissions: ugo+rw
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:43 devstack sudo[105821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.info
Sep 16 08:56:43 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Flow 'volume_create_manager' (85bef143-011c-4eae-9096-e8997779352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ada8e7-167c-4444-b007-5bb83d21d16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ada8e7-167c-4444-b007-5bb83d21d16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160998984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c7f58a-4963-44b4-b761-d3e5915aee7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa660699874a464085ffc5ae6be63aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:43Z,use_quota=True,user_id='5eebeb8433264e57a5435225ea947bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c12475-ad49-4ec7-8630-274bef94a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c12475-ad49-4ec7-8630-274bef94a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885464db-8887-45bc-8d58-bb11f567b784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885464db-8887-45bc-8d58-bb11f567b784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27c7f58a-4963-44b4-b761-d3e5915aee7a', 'volume_name': 'volume-27c7f58a-4963-44b4-b761-d3e5915aee7a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93471c7f-98e6-4004-8c18-2d5968da54cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93471c7f-98e6-4004-8c18-2d5968da54cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5f9156-4e7d-4690-bbff-22e905693e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:43 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Volume 27c7f58a-4963-44b4-b761-d3e5915aee7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27c7f58a-4963-44b4-b761-d3e5915aee7a', 'volume_size': 1}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:43 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.info" returned: 0 in 0.270s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.025s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160998984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c7f58a-4963-44b4-b761-d3e5915aee7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa660699874a464085ffc5ae6be63aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:43Z,use_quota=True,user_id='5eebeb8433264e57a5435225ea947bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Creating volume 27c7f58a-4963-44b4-b761-d3e5915aee7a {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:43 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:43 devstack sudo[105824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a 1073741824
Sep 16 08:56:43 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:43 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0c6cc965-1697-40c3-b3b0-c2c72861a2f6 tempest-ProjectMemberTests-1200760860 None] Create snapshot completed successfully
Sep 16 08:56:43 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a 1073741824" returned: 0 in 0.408s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:43 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:44 devstack sudo[105829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a
Sep 16 08:56:44 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:44 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a" returned: 0 in 0.246s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5f9156-4e7d-4690-bbff-22e905693e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27c7f58a-4963-44b4-b761-d3e5915aee7a', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e88fc60-0b8d-4bbb-a72c-b13ac3abb77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:44 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Volume volume-27c7f58a-4963-44b4-b761-d3e5915aee7a (27c7f58a-4963-44b4-b761-d3e5915aee7a): created successfully
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e88fc60-0b8d-4bbb-a72c-b13ac3abb77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Flow 'volume_create_manager' (85bef143-011c-4eae-9096-e8997779352c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:44 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d3a30da7-ba1e-434d-a3ed-2b0a8972a57e tempest-ProjectReaderTests-1349002459 None] Created volume successfully.
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] Creating offline snapshot db3a9f99-7c20-43ef-bf7f-af32c3107043 of volume 27c7f58a-4963-44b4-b761-d3e5915aee7a {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9912298d-b8b7-4958-acdf-d207c5ecdea4]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-bcb90fd8-b08e-493b-a5dc-fda7fe345a45-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-bcb90fd8-b08e-493b-a5dc-fda7fe345a45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-457c3be7-fa9a-44e9-90ec-05a320731d61" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:44 devstack sudo[105832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a
Sep 16 08:56:44 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-457c3be7-fa9a-44e9-90ec-05a320731d61" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-bcb90fd8-b08e-493b-a5dc-fda7fe345a45" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-bcb90fd8-b08e-493b-a5dc-fda7fe345a45" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Deleting offline snapshot bcb90fd8-b08e-493b-a5dc-fda7fe345a45 of volume 457c3be7-fa9a-44e9-90ec-05a320731d61 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] snapshot_file for this snap is: volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb94f912-ea22-47c6-b6da-bb15c878ed12]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:44 devstack sudo[105834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45
Sep 16 08:56:44 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:45 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a" returned: 0 in 0.400s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:45 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043 1G
Sep 16 08:56:45 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:45 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45" returned: 0 in 0.361s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-457c3be7-fa9a-44e9-90ec-05a320731d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ade93d2-e459-4500-a163-b1a7c9b6b1e4]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:45 devstack sudo[105844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61
Sep 16 08:56:45 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:45 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043 1G" returned: 0 in 0.383s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27c7f58a-4963-44b4-b761-d3e5915aee7a -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:45 devstack sudo[105849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27c7f58a-4963-44b4-b761-d3e5915aee7a -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043
Sep 16 08:56:45 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:45 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61" returned: 0 in 0.377s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:45 devstack sudo[105854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45
Sep 16 08:56:45 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:45 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27c7f58a-4963-44b4-b761-d3e5915aee7a -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043" returned: 0 in 0.301s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:45 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043 is being set with open permissions: ugo+rw
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:45 devstack sudo[105859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043
Sep 16 08:56:45 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:45 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45" returned: 0 in 0.328s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:45 devstack sudo[105864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45
Sep 16 08:56:45 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:45 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043" returned: 0 in 0.263s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:46 devstack sudo[105867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.info
Sep 16 08:56:46 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:46 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61.bcb90fd8-b08e-493b-a5dc-fda7fe345a45" returned: 0 in 0.270s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-bcb90fd8-b08e-493b-a5dc-fda7fe345a45" released by "_delete_snapshot" :: held 1.430s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-457c3be7-fa9a-44e9-90ec-05a320731d61" released by "delete_snapshot" :: held 1.452s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Created reservations ['5befd294-19f6-4749-b619-b6fde69c9e96', '82c42036-4ab6-4f79-beb2-ec52b8a84c25', '4eb8f3b5-f46d-40ce-8653-11b011992665', 'ef577199-b68b-4181-a00e-3e29c7577ab2'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:46 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.info" returned: 0 in 0.267s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:46 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.info is being set with open permissions: ugo+rw
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:46 devstack sudo[105871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.info
Sep 16 08:56:46 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:46 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Delete snapshot completed successfully.
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-447a46ba-e1b9-4254-9cf6-e692897168c8 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-bcb90fd8-b08e-493b-a5dc-fda7fe345a45-delete_snapshot" released by "delete_snapshot" :: held 1.612s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:46 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.info" returned: 0 in 0.255s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:46 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-8b3b307a-5b79-46ff-8ce9-c9c58837a6d8 tempest-ProjectReaderTests-1349002459 None] Create snapshot completed successfully
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-db3a9f99-7c20-43ef-bf7f-af32c3107043-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-db3a9f99-7c20-43ef-bf7f-af32c3107043-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-27c7f58a-4963-44b4-b761-d3e5915aee7a" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-27c7f58a-4963-44b4-b761-d3e5915aee7a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-db3a9f99-7c20-43ef-bf7f-af32c3107043" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-db3a9f99-7c20-43ef-bf7f-af32c3107043" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Deleting offline snapshot db3a9f99-7c20-43ef-bf7f-af32c3107043 of volume 27c7f58a-4963-44b4-b761-d3e5915aee7a {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] snapshot_file for this snap is: volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ad72d6-f78b-4e91-a5e3-87263b183a6d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-457c3be7-fa9a-44e9-90ec-05a320731d61-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Lock "cinder-457c3be7-fa9a-44e9-90ec-05a320731d61-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-457c3be7-fa9a-44e9-90ec-05a320731d61" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-457c3be7-fa9a-44e9-90ec-05a320731d61" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:46 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043
Sep 16 08:56:46 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa74833-c968-45bc-a682-5f676f01d9f1]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:47 devstack sudo[105876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61
Sep 16 08:56:47 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:47 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043" returned: 0 in 0.397s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27c7f58a-4963-44b4-b761-d3e5915aee7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[370ed935-ee53-4718-9464-7d1b3c3b7cbd]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:47 devstack sudo[105881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a
Sep 16 08:56:47 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:47 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61" returned: 0 in 0.407s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:47 devstack sudo[105920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61
Sep 16 08:56:47 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:47 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a" returned: 0 in 0.417s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:47 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-457c3be7-fa9a-44e9-90ec-05a320731d61" returned: 0 in 0.297s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:47 devstack sudo[105928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043
Sep 16 08:56:47 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-457c3be7-fa9a-44e9-90ec-05a320731d61" released by "delete_volume" :: held 0.775s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Created reservations ['0f37d17e-2f77-40b7-aaae-91f1d85bc07e', '057c9b83-fc5f-42a9-8173-c75c10192ea0', '24309710-9b03-47f8-adf5-12db99478a67', 'e28a2758-4a0a-4e57-a6b5-207d1c1b643f'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:47 devstack sudo[105930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:47 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:48 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043" returned: 0 in 0.385s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:48 devstack sudo[105935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043
Sep 16 08:56:48 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:48 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.273s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:48 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Deleted volume successfully.
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4ec3aaa0-d0ee-4f49-ae3c-6c8cda26b63b tempest-ProjectMemberTests-1200760860 None] Lock "cinder-457c3be7-fa9a-44e9-90ec-05a320731d61-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:48 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a.db3a9f99-7c20-43ef-bf7f-af32c3107043" returned: 0 in 0.296s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-db3a9f99-7c20-43ef-bf7f-af32c3107043" released by "_delete_snapshot" :: held 1.639s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-27c7f58a-4963-44b4-b761-d3e5915aee7a" released by "delete_snapshot" :: held 1.667s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Created reservations ['78ef5107-fd20-4d58-a538-fae888dcd678', '129fb6ac-d1be-4884-9479-e75d54d9ca8b', '284dd113-f3b0-4a9d-b629-a41aedbdaa94', 'c07cd5c9-e93a-4946-a1fb-e792736e1438'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:48 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Delete snapshot completed successfully.
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (3013af30-5de7-4ac4-bfd6-3dc58f3373ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe0429fc-2c3b-4b8f-b988-6b961a547f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-435bbc7b-64bb-4788-b489-05a91d80bbd9 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-db3a9f99-7c20-43ef-bf7f-af32c3107043-delete_snapshot" released by "delete_snapshot" :: held 1.852s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe0429fc-2c3b-4b8f-b988-6b961a547f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113603550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241992d3-4c0c-4e2e-bbd1-965f719637f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:48Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351f1115-633b-4c7d-b473-d6b92394766d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351f1115-633b-4c7d-b473-d6b92394766d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cedae96-d95a-40d0-be5e-6d0d4ea10b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cedae96-d95a-40d0-be5e-6d0d4ea10b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241992d3-4c0c-4e2e-bbd1-965f719637f4', 'volume_name': 'volume-241992d3-4c0c-4e2e-bbd1-965f719637f4', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afb18ac-ce1d-4969-a353-4f69a6bcaab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afb18ac-ce1d-4969-a353-4f69a6bcaab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31301800-e4a7-425e-8c51-7e3adb6d084c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:48 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Volume 241992d3-4c0c-4e2e-bbd1-965f719637f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241992d3-4c0c-4e2e-bbd1-965f719637f4', 'volume_size': 1}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113603550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241992d3-4c0c-4e2e-bbd1-965f719637f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:48Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Creating volume 241992d3-4c0c-4e2e-bbd1-965f719637f4 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:48 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:48 devstack sudo[105939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4 1073741824
Sep 16 08:56:48 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-27c7f58a-4963-44b4-b761-d3e5915aee7a-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-27c7f58a-4963-44b4-b761-d3e5915aee7a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-27c7f58a-4963-44b4-b761-d3e5915aee7a" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-27c7f58a-4963-44b4-b761-d3e5915aee7a" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a80a4c2-9f23-4b96-8cca-125a5a06bf71]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:49 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:49 devstack sudo[105945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a
Sep 16 08:56:49 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4 1073741824" returned: 0 in 0.488s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:49 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4
Sep 16 08:56:49 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:49 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a" returned: 0 in 0.375s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:49 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a
Sep 16 08:56:49 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:49 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4" returned: 0 in 0.263s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31301800-e4a7-425e-8c51-7e3adb6d084c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241992d3-4c0c-4e2e-bbd1-965f719637f4', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95879f6-32f6-430d-8a10-f129090df65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:49 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Volume volume-241992d3-4c0c-4e2e-bbd1-965f719637f4 (241992d3-4c0c-4e2e-bbd1-965f719637f4): created successfully
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95879f6-32f6-430d-8a10-f129090df65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (3013af30-5de7-4ac4-bfd6-3dc58f3373ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:49 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-28116976-5a63-4e2b-8d0c-3d3a8cb09d4f tempest-ProjectMemberTests-1200760860 None] Created volume successfully.
Sep 16 08:56:49 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-27c7f58a-4963-44b4-b761-d3e5915aee7a" returned: 0 in 0.261s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-27c7f58a-4963-44b4-b761-d3e5915aee7a" released by "delete_volume" :: held 0.706s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Created reservations ['0ca7a6b9-4c66-4bb3-8de4-7c032aac0e96', '8ef3584e-f45a-40c7-a4ce-24d41d6e0ceb', 'fbd80169-a7bb-4e96-91e1-3f9dbb725db6', 'e66b2434-464b-4600-999c-1d1aca7ec9a7'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:49 devstack sudo[105956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:49 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:50 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.245s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Deleted volume successfully.
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c91c1efe-71b1-4323-aeff-be99975fdc59 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-27c7f58a-4963-44b4-b761-d3e5915aee7a-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Flow 'volume_create_manager' (58f45c1e-df2b-4322-8de0-cbf1ae2c5766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac827a5-8f85-46b3-a688-91ed242a745b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac827a5-8f85-46b3-a688-91ed242a745b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1342336138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a11cd0-fe86-4a93-b91b-129659f51ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa660699874a464085ffc5ae6be63aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:50Z,use_quota=True,user_id='5eebeb8433264e57a5435225ea947bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca37aa43-34a5-405a-ae8b-0db432898039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca37aa43-34a5-405a-ae8b-0db432898039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4672edee-5e01-41da-9c20-01882e391917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4672edee-5e01-41da-9c20-01882e391917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a11cd0-fe86-4a93-b91b-129659f51ff3', 'volume_name': 'volume-70a11cd0-fe86-4a93-b91b-129659f51ff3', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca2ae14-05c1-4bb6-b3cc-3f0525069f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca2ae14-05c1-4bb6-b3cc-3f0525069f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d292ba4d-648c-4c5f-906e-6ed933f5d9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:50 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Volume 70a11cd0-fe86-4a93-b91b-129659f51ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a11cd0-fe86-4a93-b91b-129659f51ff3', 'volume_size': 1}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1342336138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a11cd0-fe86-4a93-b91b-129659f51ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa660699874a464085ffc5ae6be63aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:50Z,use_quota=True,user_id='5eebeb8433264e57a5435225ea947bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Creating volume 70a11cd0-fe86-4a93-b91b-129659f51ff3 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:50 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:50 devstack sudo[105959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3 1073741824
Sep 16 08:56:50 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:50 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3 1073741824" returned: 0 in 0.421s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:51 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3
Sep 16 08:56:51 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:51 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3" returned: 0 in 0.236s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.475s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d292ba4d-648c-4c5f-906e-6ed933f5d9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a11cd0-fe86-4a93-b91b-129659f51ff3', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1565e240-376a-4a50-8972-40df407b77f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] Creating offline snapshot dcfe2dcb-079e-4a54-a706-79597daf5fd7 of volume 241992d3-4c0c-4e2e-bbd1-965f719637f4 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:51 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Volume volume-70a11cd0-fe86-4a93-b91b-129659f51ff3 (70a11cd0-fe86-4a93-b91b-129659f51ff3): created successfully
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1565e240-376a-4a50-8972-40df407b77f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Flow 'volume_create_manager' (58f45c1e-df2b-4322-8de0-cbf1ae2c5766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47a68b3-7a43-4a36-b9ef-aeecfb055b5b]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:51 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-5d7609ad-b8a7-49b2-939e-048d10085243 tempest-ProjectReaderTests-1349002459 None] Created volume successfully.
Sep 16 08:56:51 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4
Sep 16 08:56:51 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:51 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4" returned: 0 in 0.393s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:51 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:51 devstack sudo[105973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7 1G
Sep 16 08:56:51 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:52 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7 1G" returned: 0 in 0.418s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241992d3-4c0c-4e2e-bbd1-965f719637f4 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:52 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241992d3-4c0c-4e2e-bbd1-965f719637f4 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7
Sep 16 08:56:52 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:52 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241992d3-4c0c-4e2e-bbd1-965f719637f4 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7" returned: 0 in 0.281s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:52 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7 is being set with open permissions: ugo+rw
Sep 16 08:56:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:52 devstack sudo[105984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7
Sep 16 08:56:52 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:52 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7" returned: 0 in 0.247s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:52 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.info
Sep 16 08:56:52 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:52 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.info" returned: 0 in 0.268s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:52 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.info is being set with open permissions: ugo+rw
Sep 16 08:56:52 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:52 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.info
Sep 16 08:56:52 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:53 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.info" returned: 0 in 0.253s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.569s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:53 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] Creating offline snapshot ad0d1961-3b96-40b7-8664-1fbdf5df9664 of volume 70a11cd0-fe86-4a93-b91b-129659f51ff3 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:53 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-e9e04cb8-c0fe-4a3e-81cb-c26095f19750 tempest-ProjectMemberTests-1200760860 None] Create snapshot completed successfully
Sep 16 08:56:53 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91df5e4-309f-498b-9a64-d435591e15e5]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:53 devstack sudo[105993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3
Sep 16 08:56:53 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:53 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3" returned: 0 in 0.359s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:53 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664 1G
Sep 16 08:56:53 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-dcfe2dcb-079e-4a54-a706-79597daf5fd7-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Lock "cinder-dcfe2dcb-079e-4a54-a706-79597daf5fd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:53 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-241992d3-4c0c-4e2e-bbd1-965f719637f4" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-241992d3-4c0c-4e2e-bbd1-965f719637f4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-dcfe2dcb-079e-4a54-a706-79597daf5fd7" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-dcfe2dcb-079e-4a54-a706-79597daf5fd7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Deleting offline snapshot dcfe2dcb-079e-4a54-a706-79597daf5fd7 of volume 241992d3-4c0c-4e2e-bbd1-965f719637f4 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] snapshot_file for this snap is: volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:56:54 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664 1G" returned: 0 in 0.441s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a11cd0-fe86-4a93-b91b-129659f51ff3 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[494e62b1-4e2f-4f5a-a183-7878cfdb89ad]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:54 devstack sudo[106005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a11cd0-fe86-4a93-b91b-129659f51ff3 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664
Sep 16 08:56:54 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:54 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7
Sep 16 08:56:54 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:54 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a11cd0-fe86-4a93-b91b-129659f51ff3 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664" returned: 0 in 0.285s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:54 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664 is being set with open permissions: ugo+rw
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:54 devstack sudo[106012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664
Sep 16 08:56:54 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:54 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7" returned: 0 in 0.378s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241992d3-4c0c-4e2e-bbd1-965f719637f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f56290-b7c3-4fac-88c5-0933131ba738]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:54 devstack sudo[106017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4
Sep 16 08:56:54 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:54 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664" returned: 0 in 0.262s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:54 devstack sudo[106026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.info
Sep 16 08:56:54 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:54 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4" returned: 0 in 0.384s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:54 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:54 devstack sudo[106032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7
Sep 16 08:56:54 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.info" returned: 0 in 0.263s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:54 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.info is being set with open permissions: ugo+rw
Sep 16 08:56:54 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:54 devstack sudo[106034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.info
Sep 16 08:56:54 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:55 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.info" returned: 0 in 0.251s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.951s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:55 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-077ede25-0e6d-471d-8744-065c3cde5aa0 tempest-ProjectReaderTests-1349002459 None] Create snapshot completed successfully
Sep 16 08:56:55 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7" returned: 0 in 0.339s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:55 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7
Sep 16 08:56:55 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:55 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4.dcfe2dcb-079e-4a54-a706-79597daf5fd7" returned: 0 in 0.249s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-dcfe2dcb-079e-4a54-a706-79597daf5fd7" released by "_delete_snapshot" :: held 1.451s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-241992d3-4c0c-4e2e-bbd1-965f719637f4" released by "delete_snapshot" :: held 1.475s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Created reservations ['86a77fb0-5403-4316-bc5d-9af36dcfa832', '574091bb-63ec-4246-80f1-585c8705b537', 'a32d53c2-eb39-4cc2-8cc8-c256666c0402', '8bf0436e-86d4-49b8-b206-2e678cd93faa'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:55 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Delete snapshot completed successfully.
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-0604accc-2a0a-4ff3-bf37-5d910be85c7c tempest-ProjectMemberTests-1200760860 None] Lock "cinder-dcfe2dcb-079e-4a54-a706-79597daf5fd7-delete_snapshot" released by "delete_snapshot" :: held 1.605s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-ad0d1961-3b96-40b7-8664-1fbdf5df9664-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Lock "cinder-ad0d1961-3b96-40b7-8664-1fbdf5df9664-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-70a11cd0-fe86-4a93-b91b-129659f51ff3" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-70a11cd0-fe86-4a93-b91b-129659f51ff3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-ad0d1961-3b96-40b7-8664-1fbdf5df9664" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-ad0d1961-3b96-40b7-8664-1fbdf5df9664" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Deleting offline snapshot ad0d1961-3b96-40b7-8664-1fbdf5df9664 of volume 70a11cd0-fe86-4a93-b91b-129659f51ff3 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] snapshot_file for this snap is: volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32475d3-f259-4ef3-ba96-cf85fcb17abf]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:55 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:56 devstack sudo[106043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664
Sep 16 08:56:56 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-241992d3-4c0c-4e2e-bbd1-965f719637f4-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-241992d3-4c0c-4e2e-bbd1-965f719637f4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-241992d3-4c0c-4e2e-bbd1-965f719637f4" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-241992d3-4c0c-4e2e-bbd1-965f719637f4" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[684749bc-5460-4fad-9f8f-b1de8bd14ed6]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:56 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664" returned: 0 in 0.367s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70a11cd0-fe86-4a93-b91b-129659f51ff3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ad2799-8b2c-4c66-9a29-22631273a49f]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:56 devstack sudo[106048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4
Sep 16 08:56:56 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:56 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3
Sep 16 08:56:56 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:56 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4" returned: 0 in 0.372s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:56 devstack sudo[106057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4
Sep 16 08:56:56 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:56 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3" returned: 0 in 0.366s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:56 devstack sudo[106060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664
Sep 16 08:56:56 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:56 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-241992d3-4c0c-4e2e-bbd1-965f719637f4" returned: 0 in 0.272s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-241992d3-4c0c-4e2e-bbd1-965f719637f4" released by "delete_volume" :: held 0.707s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:56 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Created reservations ['df72473c-888f-48c0-830d-7d5bf23d7d1e', '5b01ffba-72b6-4a08-a851-99709a8d65ca', 'ad92f441-9b63-46db-96eb-4d836fd1c090', '84092f0f-aeaa-4840-ab1a-c68a2744cf59'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:57 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664" returned: 0 in 0.379s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:57 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:57 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:57 devstack sudo[106068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664
Sep 16 08:56:57 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:57 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.253s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:57 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Deleted volume successfully.
Sep 16 08:56:57 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3.ad0d1961-3b96-40b7-8664-1fbdf5df9664" returned: 0 in 0.263s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-ad0d1961-3b96-40b7-8664-1fbdf5df9664" released by "_delete_snapshot" :: held 1.476s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-ae9c4db8-95c5-49ef-828d-0db08cc56c32 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-241992d3-4c0c-4e2e-bbd1-965f719637f4-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-70a11cd0-fe86-4a93-b91b-129659f51ff3" released by "delete_snapshot" :: held 1.504s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Created reservations ['474679c9-58dc-4b8d-805d-1b6e5f1e3855', '8ef9441a-729f-424f-9458-c736af239825', 'd7552ae1-bd75-498a-9929-d406bd9a1f94', '76325328-5944-4a3d-8c8f-ae761d3d22fb'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:57 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Delete snapshot completed successfully.
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-c4eaf611-6036-4953-97d3-ed25c6e6a0bc tempest-ProjectReaderTests-1349002459 None] Lock "cinder-ad0d1961-3b96-40b7-8664-1fbdf5df9664-delete_snapshot" released by "delete_snapshot" :: held 1.629s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (75712438-414b-4119-af57-1d84a98c5f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d22621-bfc3-4a87-870e-e74cb99d5e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d22621-bfc3-4a87-870e-e74cb99d5e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-916924845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d63db4-519c-45e1-974a-647a3026539f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:58Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718aa1cb-e29d-49ae-9805-c56e8eca3d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718aa1cb-e29d-49ae-9805-c56e8eca3d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20007865-f5bd-4b58-b955-84725bf8a81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20007865-f5bd-4b58-b955-84725bf8a81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d63db4-519c-45e1-974a-647a3026539f', 'volume_name': 'volume-53d63db4-519c-45e1-974a-647a3026539f', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c04b30-956c-496d-9f16-f7d845a6e17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c04b30-956c-496d-9f16-f7d845a6e17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ff31fe-1c43-48f6-a6fd-c5af5584e05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:57 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Volume 53d63db4-519c-45e1-974a-647a3026539f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d63db4-519c-45e1-974a-647a3026539f', 'volume_size': 1}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-916924845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d63db4-519c-45e1-974a-647a3026539f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca15715482c24f718d010bb5145ac60b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:56:58Z,use_quota=True,user_id='c557de17855f430781f28473d91a754d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Creating volume 53d63db4-519c-45e1-974a-647a3026539f {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:56:57 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:57 devstack sudo[106073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f 1073741824
Sep 16 08:56:57 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:57 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-70a11cd0-fe86-4a93-b91b-129659f51ff3-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-70a11cd0-fe86-4a93-b91b-129659f51ff3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "cinder-quobyte-70a11cd0-fe86-4a93-b91b-129659f51ff3" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-70a11cd0-fe86-4a93-b91b-129659f51ff3" acquired by "delete_volume" :: waited 0.018s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[117bbd04-bc82-41e2-80e2-b8dd7173ee56]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:58 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3
Sep 16 08:56:58 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:58 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f 1073741824" returned: 0 in 0.462s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:58 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f
Sep 16 08:56:58 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:58 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3" returned: 0 in 0.395s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:58 devstack sudo[106086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3
Sep 16 08:56:58 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:58 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f" returned: 0 in 0.262s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ff31fe-1c43-48f6-a6fd-c5af5584e05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d63db4-519c-45e1-974a-647a3026539f', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a24dc5-33fc-4746-a141-2ea7337234d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:56:58 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Volume volume-53d63db4-519c-45e1-974a-647a3026539f (53d63db4-519c-45e1-974a-647a3026539f): created successfully
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a24dc5-33fc-4746-a141-2ea7337234d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Flow 'volume_create_manager' (75712438-414b-4119-af57-1d84a98c5f19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:56:58 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-1b36f764-1fdb-45aa-b3fe-68124186b43a tempest-ProjectMemberTests-1200760860 None] Created volume successfully.
Sep 16 08:56:58 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-70a11cd0-fe86-4a93-b91b-129659f51ff3" returned: 0 in 0.265s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-quobyte-70a11cd0-fe86-4a93-b91b-129659f51ff3" released by "delete_volume" :: held 0.731s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Created reservations ['ef18e9fe-3a84-4e82-9d60-3a2fb9faa9bc', '082f1909-6d68-43e0-99c4-4f014d75ac16', '6eb17305-940d-4ac0-8a12-449c9e1bb97d', 'f52a7936-16bf-4860-be96-305162cbf596'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:58 devstack sudo[106090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:56:58 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:56:58 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] Creating offline snapshot 5b8d0331-028d-4a24-b610-d82ecf9980c7 of volume 53d63db4-519c-45e1-974a-647a3026539f {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:56:59 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba48a3b-cf43-43e3-b0ce-c7279093f993]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:56:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:59 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f
Sep 16 08:56:59 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:59 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.266s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:59 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:56:59 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Deleted volume successfully.
Sep 16 08:56:59 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4f62cb55-c4bd-493a-9057-a4a89aaceec2 tempest-ProjectReaderTests-1349002459 None] Lock "cinder-70a11cd0-fe86-4a93-b91b-129659f51ff3-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:56:59 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f" returned: 0 in 0.382s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:59 devstack sudo[106098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7 1G
Sep 16 08:56:59 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:56:59 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root
Sep 16 08:56:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7 1G" returned: 0 in 0.488s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:56:59 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53d63db4-519c-45e1-974a-647a3026539f -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:56:59 devstack sudo[106104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53d63db4-519c-45e1-974a-647a3026539f -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7
Sep 16 08:56:59 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:00 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53d63db4-519c-45e1-974a-647a3026539f -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7" returned: 0 in 0.334s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:00 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7 is being set with open permissions: ugo+rw
Sep 16 08:57:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:00 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7
Sep 16 08:57:00 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:00 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7" returned: 0 in 0.260s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:00 devstack sudo[106113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.info
Sep 16 08:57:00 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:00 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.info" returned: 0 in 0.268s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:00 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.info is being set with open permissions: ugo+rw
Sep 16 08:57:00 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:00 devstack sudo[106116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.info
Sep 16 08:57:00 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:01 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.info" returned: 0 in 0.253s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:01 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.067s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:01 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-ae89a563-c480-487b-af22-6ecc176dc035 tempest-ProjectMemberTests-1200760860 None] Create snapshot completed successfully
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-5b8d0331-028d-4a24-b610-d82ecf9980c7-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Lock "cinder-5b8d0331-028d-4a24-b610-d82ecf9980c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-53d63db4-519c-45e1-974a-647a3026539f" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-53d63db4-519c-45e1-974a-647a3026539f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-5b8d0331-028d-4a24-b610-d82ecf9980c7" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-5b8d0331-028d-4a24-b610-d82ecf9980c7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Deleting offline snapshot 5b8d0331-028d-4a24-b610-d82ecf9980c7 of volume 53d63db4-519c-45e1-974a-647a3026539f {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] snapshot_file for this snap is: volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aafdcc-4a2e-4abc-99d0-3be324315d60]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:02 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7
Sep 16 08:57:02 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:02 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7" returned: 0 in 0.368s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53d63db4-519c-45e1-974a-647a3026539f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[66468c79-fb71-4d2b-a565-258a614777a3]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:57:02 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:02 devstack sudo[106125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f
Sep 16 08:57:02 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:03 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f" returned: 0 in 0.354s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:03 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7
Sep 16 08:57:03 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:03 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7" returned: 0 in 0.351s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:03 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7
Sep 16 08:57:03 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:03 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:03 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f.5b8d0331-028d-4a24-b610-d82ecf9980c7" returned: 0 in 0.256s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:03 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-5b8d0331-028d-4a24-b610-d82ecf9980c7" released by "_delete_snapshot" :: held 1.429s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:03 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-53d63db4-519c-45e1-974a-647a3026539f" released by "delete_snapshot" :: held 1.451s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:03 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=176,cinder:INSERT=66,cinder:UPDATE=233,cinder:DELETE=19 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:57:03 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=187,cinder:UPDATE=231,cinder:INSERT=63,cinder:DELETE=20 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:57:03 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Created reservations ['0c6aaf9e-e4f8-4761-9760-d6fe492a6504', '984dd66d-7a1d-4614-885b-4cb597a81b1f', 'bbe30741-848b-4e47-ab2a-ce133481a453', '7c1c84d1-48e4-4dad-91b9-2e11f5ba1398'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:57:03 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Delete snapshot completed successfully.
Sep 16 08:57:03 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-cae03a1b-90fe-4708-80a8-64a57ff3778d tempest-ProjectMemberTests-1200760860 None] Lock "cinder-5b8d0331-028d-4a24-b610-d82ecf9980c7-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:04 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-53d63db4-519c-45e1-974a-647a3026539f-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:04 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-53d63db4-519c-45e1-974a-647a3026539f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:04 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "cinder-quobyte-53d63db4-519c-45e1-974a-647a3026539f" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:04 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-53d63db4-519c-45e1-974a-647a3026539f" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:04 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[28543feb-eb49-4125-b01a-99464025e6b4]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:57:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:04 devstack sudo[106138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f
Sep 16 08:57:04 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:04 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f" returned: 0 in 0.373s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:04 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:04 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f
Sep 16 08:57:04 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:05 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-53d63db4-519c-45e1-974a-647a3026539f" returned: 0 in 0.247s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-quobyte-53d63db4-519c-45e1-974a-647a3026539f" released by "delete_volume" :: held 0.684s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:05 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Created reservations ['fd1d0d52-81e5-4415-8e96-46efb4066c5e', '5c7e8e76-6922-48ee-b6e3-4bcdaab2bbf3', '0de69c90-abb7-4664-b95d-556c4656c5dc', '66a8db61-7de6-4f74-a163-b4745ababe43'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:57:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:57:05 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:57:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:05 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:57:05 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:05 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:05 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.271s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:05 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:57:05 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Deleted volume successfully.
Sep 16 08:57:05 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-21c015f2-e6fb-4757-a171-7041402145b5 tempest-ProjectMemberTests-1200760860 None] Lock "cinder-53d63db4-519c-45e1-974a-647a3026539f-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Flow 'volume_create_manager' (de0efd4e-353e-4393-892b-f56030098f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b86459-1212-4d4e-aef3-97aa93a7b48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b86459-1212-4d4e-aef3-97aa93a7b48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352471051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea755baa-2bb4-419d-be6c-78896e1700eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc22a5c75594e328375c0526b77336b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:57:09Z,use_quota=True,user_id='3d7deb0622bc4fdcb7bca8a8247bbd73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e9e479-156d-4e85-b84c-c763fe1a028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e9e479-156d-4e85-b84c-c763fe1a028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be3d238-eb10-446e-9c5a-41e1527c8095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be3d238-eb10-446e-9c5a-41e1527c8095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea755baa-2bb4-419d-be6c-78896e1700eb', 'volume_name': 'volume-ea755baa-2bb4-419d-be6c-78896e1700eb', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e8d4fe-e67f-491b-a181-b2d4b80ce2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e8d4fe-e67f-491b-a181-b2d4b80ce2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ceea8b6-9155-4e33-b603-7a1a706b37a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:09 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Volume ea755baa-2bb4-419d-be6c-78896e1700eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea755baa-2bb4-419d-be6c-78896e1700eb', 'volume_size': 1}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352471051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea755baa-2bb4-419d-be6c-78896e1700eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc22a5c75594e328375c0526b77336b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:57:09Z,use_quota=True,user_id='3d7deb0622bc4fdcb7bca8a8247bbd73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Creating volume ea755baa-2bb4-419d-be6c-78896e1700eb {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:57:09 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea755baa-2bb4-419d-be6c-78896e1700eb 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:09 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea755baa-2bb4-419d-be6c-78896e1700eb 1073741824
Sep 16 08:57:09 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:09 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea755baa-2bb4-419d-be6c-78896e1700eb 1073741824" returned: 0 in 0.428s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:09 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea755baa-2bb4-419d-be6c-78896e1700eb {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:09 devstack sudo[106155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea755baa-2bb4-419d-be6c-78896e1700eb
Sep 16 08:57:09 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:10 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea755baa-2bb4-419d-be6c-78896e1700eb" returned: 0 in 0.255s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ceea8b6-9155-4e33-b603-7a1a706b37a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea755baa-2bb4-419d-be6c-78896e1700eb', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a00792-21be-4674-8c3e-96e1bd84b8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:10 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Volume volume-ea755baa-2bb4-419d-be6c-78896e1700eb (ea755baa-2bb4-419d-be6c-78896e1700eb): created successfully
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a00792-21be-4674-8c3e-96e1bd84b8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Flow 'volume_create_manager' (de0efd4e-353e-4393-892b-f56030098f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:57:10 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-37475557-9988-4bdd-bf0f-f65fcee32898 tempest-ProjectReaderTests-14180857 None] Created volume successfully.
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Acquiring lock "cinder-ea755baa-2bb4-419d-be6c-78896e1700eb-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Lock "cinder-ea755baa-2bb4-419d-be6c-78896e1700eb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Acquiring lock "cinder-quobyte-ea755baa-2bb4-419d-be6c-78896e1700eb" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Lock "cinder-quobyte-ea755baa-2bb4-419d-be6c-78896e1700eb" acquired by "delete_volume" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb61015-77e7-4d73-9323-4317f3063d24]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:57:10 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea755baa-2bb4-419d-be6c-78896e1700eb {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:10 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea755baa-2bb4-419d-be6c-78896e1700eb
Sep 16 08:57:10 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:11 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea755baa-2bb4-419d-be6c-78896e1700eb" returned: 0 in 0.355s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea755baa-2bb4-419d-be6c-78896e1700eb {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:11 devstack sudo[106163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea755baa-2bb4-419d-be6c-78896e1700eb
Sep 16 08:57:11 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:11 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-ea755baa-2bb4-419d-be6c-78896e1700eb" returned: 0 in 0.239s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Lock "cinder-quobyte-ea755baa-2bb4-419d-be6c-78896e1700eb" released by "delete_volume" :: held 0.635s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Created reservations ['534237d0-b0a6-4e98-803a-72a165f8a38b', '216735d0-ef26-404e-b349-c700603cd81c', '11ba8d0f-73dc-43fb-af9b-de32534c411e', '48bdb1c6-2a65-4643-afef-271cb4d6a279'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:11 devstack sudo[106166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:57:11 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:11 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.232s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:57:11 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Deleted volume successfully.
Sep 16 08:57:11 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-4deedf11-7059-4f3b-ae88-eb94a2109b23 tempest-ProjectReaderTests-14180857 None] Lock "cinder-ea755baa-2bb4-419d-be6c-78896e1700eb-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Flow 'volume_create_manager' (2d59ad86-101c-4153-a8aa-c6d50b782ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c719e816-e1cd-4426-83e5-8766f04932e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c719e816-e1cd-4426-83e5-8766f04932e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887520380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fca55f6-e637-49af-8ef3-1041aa5ce8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc22a5c75594e328375c0526b77336b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:57:12Z,use_quota=True,user_id='3d7deb0622bc4fdcb7bca8a8247bbd73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1161913d-b6a1-4f85-8a27-31da1b5ca3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1161913d-b6a1-4f85-8a27-31da1b5ca3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2b5265-4aac-4ba7-b062-f9eeb7362ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2b5265-4aac-4ba7-b062-f9eeb7362ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fca55f6-e637-49af-8ef3-1041aa5ce8e2', 'volume_name': 'volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84ef326-cc9c-4cab-9e2d-22a0c165f388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84ef326-cc9c-4cab-9e2d-22a0c165f388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534274e2-0338-45c1-ab70-df2b5bc91876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:12 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Volume 7fca55f6-e637-49af-8ef3-1041aa5ce8e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2', 'volume_size': 1}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887520380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fca55f6-e637-49af-8ef3-1041aa5ce8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc22a5c75594e328375c0526b77336b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:57:12Z,use_quota=True,user_id='3d7deb0622bc4fdcb7bca8a8247bbd73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Creating volume 7fca55f6-e637-49af-8ef3-1041aa5ce8e2 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:57:12 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:12 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2 1073741824
Sep 16 08:57:12 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:12 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2 1073741824" returned: 0 in 0.405s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:12 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:57:12 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:12 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2
Sep 16 08:57:12 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:12 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.246s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 08:57:12 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2" returned: 0 in 0.247s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534274e2-0338-45c1-ab70-df2b5bc91876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0012554c-219b-4934-976f-fe337d88466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:12 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Volume volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2 (7fca55f6-e637-49af-8ef3-1041aa5ce8e2): created successfully
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0012554c-219b-4934-976f-fe337d88466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Flow 'volume_create_manager' (2d59ad86-101c-4153-a8aa-c6d50b782ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:57:12 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-22dbaa5a-4ae1-4d15-8e9a-0012efb051ce tempest-ProjectReaderTests-14180857 None] Created volume successfully.
Sep 16 08:57:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Acquiring lock "cinder-7fca55f6-e637-49af-8ef3-1041aa5ce8e2-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Lock "cinder-7fca55f6-e637-49af-8ef3-1041aa5ce8e2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Acquiring lock "cinder-quobyte-7fca55f6-e637-49af-8ef3-1041aa5ce8e2" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Lock "cinder-quobyte-7fca55f6-e637-49af-8ef3-1041aa5ce8e2" acquired by "delete_volume" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:13 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[249cca0b-693d-47e4-85dc-aef059b9a63c]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:57:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:13 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2
Sep 16 08:57:13 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:13 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2" returned: 0 in 0.351s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:13 devstack sudo[106186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2
Sep 16 08:57:13 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:13 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:13 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-7fca55f6-e637-49af-8ef3-1041aa5ce8e2" returned: 0 in 0.264s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:13 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Lock "cinder-quobyte-7fca55f6-e637-49af-8ef3-1041aa5ce8e2" released by "delete_volume" :: held 0.655s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:13 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Created reservations ['ecbca204-c075-4324-8d00-dd7c8f88e4e4', '5d32be2c-c2e6-4adc-92a4-42aa1195e5f0', '95d26115-95de-43c7-a0f1-954d7a2d6203', 'd2298efb-7e38-43ec-881d-905d4859aeb9'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:57:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:57:14 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:57:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:14 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:57:14 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:14 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:14 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.252s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:14 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:57:14 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Deleted volume successfully.
Sep 16 08:57:14 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-44c820e7-899a-463d-81d0-8813181c07d6 tempest-ProjectReaderTests-14180857 None] Lock "cinder-7fca55f6-e637-49af-8ef3-1041aa5ce8e2-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:23 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=24,cinder:INSERT=9,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:57:24 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:INSERT=9,cinder:UPDATE=33,cinder:SELECT=21,cinder:DELETE=4 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Flow 'volume_create_manager' (9b45d69b-5df0-4e2c-9e54-a6b6a66334e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6c3d47-201d-491d-ad50-22294b93e95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6c3d47-201d-491d-ad50-22294b93e95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-854328759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b44d5c6-c49b-4972-acda-7b175d257b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6076fb2f7b4d4c39a3c8af183315ae23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:57:34Z,use_quota=True,user_id='f3bbcc48ed1845c6816348e6d07a2378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4ebc28-9275-4d28-b283-c6735f62e8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4ebc28-9275-4d28-b283-c6735f62e8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411c7690-b717-4a29-b2a0-7d6aae3b7366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411c7690-b717-4a29-b2a0-7d6aae3b7366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b44d5c6-c49b-4972-acda-7b175d257b18', 'volume_name': 'volume-0b44d5c6-c49b-4972-acda-7b175d257b18', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb72ec0e-8040-4152-8892-d646fea451f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb72ec0e-8040-4152-8892-d646fea451f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81753ae4-2fae-4891-98c4-51651267b94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:33 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Volume 0b44d5c6-c49b-4972-acda-7b175d257b18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b44d5c6-c49b-4972-acda-7b175d257b18', 'volume_size': 1}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x73e0f07c1a00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-854328759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b44d5c6-c49b-4972-acda-7b175d257b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6076fb2f7b4d4c39a3c8af183315ae23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:57:34Z,use_quota=True,user_id='f3bbcc48ed1845c6816348e6d07a2378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)}" {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Creating volume 0b44d5c6-c49b-4972-acda-7b175d257b18 {{(pid=86261) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:57:33 devstack cinder-volume[86261]: INFO cinder.volume.drivers.remotefs [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] casted to osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9
Sep 16 08:57:33 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 1073741824 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:33 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 1073741824
Sep 16 08:57:33 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:34 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 1073741824" returned: 0 in 0.452s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:34 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18
Sep 16 08:57:34 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:34 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18" returned: 0 in 0.250s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'} {{(pid=86261) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 08:57:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81753ae4-2fae-4891-98c4-51651267b94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b44d5c6-c49b-4972-acda-7b175d257b18', 'volume_size': 1}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7bd89f0-2fa1-494d-b92d-b37a66ed018a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:34 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Volume volume-0b44d5c6-c49b-4972-acda-7b175d257b18 (0b44d5c6-c49b-4972-acda-7b175d257b18): created successfully
Sep 16 08:57:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7bd89f0-2fa1-494d-b92d-b37a66ed018a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:34 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Flow 'volume_create_manager' (9b45d69b-5df0-4e2c-9e54-a6b6a66334e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:57:34 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-088403f4-6c72-4637-b7b7-0ba27ed75ffc tempest-SnapshotDependencyTests-1573500460 None] Created volume successfully.
Sep 16 08:57:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:35 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] Creating offline snapshot c0091c51-7026-4e6f-a33c-1e9696b24c20 of volume 0b44d5c6-c49b-4972-acda-7b175d257b18 {{(pid=86261) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 08:57:35 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfd1b27-3221-4f54-8871-37de577c99e5]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:57:35 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:35 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18
Sep 16 08:57:35 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:36 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18" returned: 0 in 0.342s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20 1G {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:36 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20 1G
Sep 16 08:57:36 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:36 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20 1G" returned: 0 in 0.378s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b44d5c6-c49b-4972-acda-7b175d257b18 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:36 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b44d5c6-c49b-4972-acda-7b175d257b18 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20
Sep 16 08:57:36 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:36 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b44d5c6-c49b-4972-acda-7b175d257b18 -F qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20" returned: 0 in 0.306s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:36 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20 is being set with open permissions: ugo+rw
Sep 16 08:57:36 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:36 devstack sudo[106220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20
Sep 16 08:57:36 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:37 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20" returned: 0 in 0.239s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:37 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.info
Sep 16 08:57:37 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:37 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.info" returned: 0 in 0.243s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:37 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.info is being set with open permissions: ugo+rw
Sep 16 08:57:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.info {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:37 devstack sudo[106226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.info
Sep 16 08:57:37 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:37 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.info" returned: 0 in 0.249s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:37 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:37 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a6ec2e0e-3412-4112-aa29-66666ec79a75 tempest-SnapshotDependencyTests-1573500460 None] Create snapshot completed successfully
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86261) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Flow 'volume_create_manager' (6eba90bf-9006-4d55-aa6c-70de2e12c2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22069337-08bd-4d52-b84b-0fbdeea2ad41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22069337-08bd-4d52-b84b-0fbdeea2ad41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T06:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563a752c-3924-4abf-85d3-e970ca296cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6076fb2f7b4d4c39a3c8af183315ae23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T06:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c0091c51-7026-4e6f-a33c-1e9696b24c20,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T06:57:38Z,use_quota=True,user_id='f3bbcc48ed1845c6816348e6d07a2378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c8c150-af96-4771-ad75-2e5d9599be75),volume_type_id=c5c8c150-af96-4771-ad75-2e5d9599be75)' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4b1814-61f8-427e-8177-190d03d86bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4b1814-61f8-427e-8177-190d03d86bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844740ab-b438-4ecc-a483-99e0bad132ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844740ab-b438-4ecc-a483-99e0bad132ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '563a752c-3924-4abf-85d3-e970ca296cce', 'volume_name': 'volume-563a752c-3924-4abf-85d3-e970ca296cce', 'volume_size': 1, 'snapshot_id': 'c0091c51-7026-4e6f-a33c-1e9696b24c20'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750d6621-bf70-4289-9642-9dc002e4c9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750d6621-bf70-4289-9642-9dc002e4c9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d8811d-d288-4a8c-b1f2-f8276ab3ee81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:38 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Volume 563a752c-3924-4abf-85d3-e970ca296cce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-563a752c-3924-4abf-85d3-e970ca296cce', 'volume_size': 1, 'snapshot_id': 'c0091c51-7026-4e6f-a33c-1e9696b24c20'}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "cinder-quobyte-c0091c51-7026-4e6f-a33c-1e9696b24c20-563a752c-3924-4abf-85d3-e970ca296cce" by "_create_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-quobyte-c0091c51-7026-4e6f-a33c-1e9696b24c20-563a752c-3924-4abf-85d3-e970ca296cce" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Creating volume 563a752c-3924-4abf-85d3-e970ca296cce from snapshot c0091c51-7026-4e6f-a33c-1e9696b24c20 {{(pid=86261) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Selected osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9 as target Quobyte volume. {{(pid=86261) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "cinder-quobyte-563a752c-3924-4abf-85d3-e970ca296cce" by "_copy_volume_from_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-quobyte-563a752c-3924-4abf-85d3-e970ca296cce" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] snapshot: c0091c51-7026-4e6f-a33c-1e9696b24c20, volume: 563a752c-3924-4abf-85d3-e970ca296cce,  {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf423a6-be46-440c-8658-3dd301e95c5d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:38 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20
Sep 16 08:57:38 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:38 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20" returned: 0 in 0.371s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b44d5c6-c49b-4972-acda-7b175d257b18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[feee22eb-69b6-4d20-94f7-14241db55f42]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:57:38 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:39 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18
Sep 16 08:57:39 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:39 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18" returned: 0 in 0.358s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 08:57:39 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Creating direct copy from snapshot {{(pid=86261) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 08:57:39 devstack cinder-volume[86261]: DEBUG cinder.utils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Path /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce not found in is_blk_device check {{(pid=86261) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 08:57:39 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:39 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce
Sep 16 08:57:39 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:45 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce" returned: 0 in 5.839s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce {{(pid=86261) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 08:57:45 devstack cinder-volume[86261]: INFO cinder.image.image_utils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Converted 1024.00 MB image at 175.34 MB/s
Sep 16 08:57:45 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.remotefs [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce is being set with open permissions: ugo+rw
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:45 devstack sudo[106255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce
Sep 16 08:57:45 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:45 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce" returned: 0 in 0.232s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-quobyte-563a752c-3924-4abf-85d3-e970ca296cce" released by "_copy_volume_from_snapshot" :: held 6.877s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-quobyte-c0091c51-7026-4e6f-a33c-1e9696b24c20-563a752c-3924-4abf-85d3-e970ca296cce" released by "_create_volume_from_snapshot" :: held 6.932s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.946s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d8811d-d288-4a8c-b1f2-f8276ab3ee81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563a752c-3924-4abf-85d3-e970ca296cce', 'volume_size': 1, 'snapshot_id': 'c0091c51-7026-4e6f-a33c-1e9696b24c20'}' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53ea9dd-b136-495b-9262-c2957264821a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 08:57:45 devstack cinder-volume[86261]: INFO cinder.volume.flows.manager.create_volume [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Volume volume-563a752c-3924-4abf-85d3-e970ca296cce (563a752c-3924-4abf-85d3-e970ca296cce): created successfully
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53ea9dd-b136-495b-9262-c2957264821a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86261) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Flow 'volume_create_manager' (6eba90bf-9006-4d55-aa6c-70de2e12c2d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86261) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 08:57:45 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a69cf4ea-ed5e-4d42-9df2-26dfc6539e95 tempest-SnapshotDependencyTests-1573500460 None] Created volume successfully.
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "cinder-c0091c51-7026-4e6f-a33c-1e9696b24c20-delete_snapshot" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-c0091c51-7026-4e6f-a33c-1e9696b24c20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:45 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "cinder-quobyte-0b44d5c6-c49b-4972-acda-7b175d257b18" by "delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-quobyte-0b44d5c6-c49b-4972-acda-7b175d257b18" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "cinder-quobyte-c0091c51-7026-4e6f-a33c-1e9696b24c20" by "_delete_snapshot" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-quobyte-c0091c51-7026-4e6f-a33c-1e9696b24c20" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Deleting offline snapshot c0091c51-7026-4e6f-a33c-1e9696b24c20 of volume 0b44d5c6-c49b-4972-acda-7b175d257b18 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] snapshot_file for this snap is: volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20 {{(pid=86261) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f78113-40e4-47bd-bea1-bed3ad2f024d]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:46 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20
Sep 16 08:57:46 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:46 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20" returned: 0 in 0.349s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b44d5c6-c49b-4972-acda-7b175d257b18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86261) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d78fe1-ce90-4dce-8042-1ca2e421e2b3]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:46 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18
Sep 16 08:57:46 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:46 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18" returned: 0 in 0.514s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:46 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:46 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20
Sep 16 08:57:46 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:47 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20" returned: 0 in 0.314s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:47 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20
Sep 16 08:57:47 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:47 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:47 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18.c0091c51-7026-4e6f-a33c-1e9696b24c20" returned: 0 in 0.235s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-quobyte-c0091c51-7026-4e6f-a33c-1e9696b24c20" released by "_delete_snapshot" :: held 1.507s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-quobyte-0b44d5c6-c49b-4972-acda-7b175d257b18" released by "delete_snapshot" :: held 1.528s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:47 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Created reservations ['2610b872-86da-4bef-a8c3-2289337d2b16', 'be7ff733-7e3b-41e6-8eb5-5939f84fea98', '3f51e3c2-3996-4cb8-8eac-83bac847dc8b', 'd13536c1-b380-43d8-b935-76a912eabe10'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:57:47 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Delete snapshot completed successfully.
Sep 16 08:57:47 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-854272c2-a8e6-4158-acd8-03bd3a6eb689 tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-c0091c51-7026-4e6f-a33c-1e9696b24c20-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "cinder-0b44d5c6-c49b-4972-acda-7b175d257b18-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-0b44d5c6-c49b-4972-acda-7b175d257b18-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "cinder-quobyte-0b44d5c6-c49b-4972-acda-7b175d257b18" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-quobyte-0b44d5c6-c49b-4972-acda-7b175d257b18" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[6901103e-19b4-4dab-bacc-7bf6f8a1ef72]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:48 devstack sudo[106312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18
Sep 16 08:57:48 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:48 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18" returned: 0 in 0.357s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:48 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18
Sep 16 08:57:48 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:48 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-0b44d5c6-c49b-4972-acda-7b175d257b18" returned: 0 in 0.247s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-quobyte-0b44d5c6-c49b-4972-acda-7b175d257b18" released by "delete_volume" :: held 0.663s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Created reservations ['58d100e7-c209-408b-9563-7b36a5c5f864', 'fb1ae27f-2269-4766-919e-6335dd7f8e6a', '2e4d533a-19a0-4adc-b84d-1ccee93d04d0', '20a45e47-d99e-4b29-b8bf-0486fe373d92'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:48 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:48 devstack sudo[106320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:57:48 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:49 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.238s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:57:49 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Deleted volume successfully.
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-a8b3a5a3-5eef-45d6-ad71-5aa95087990e tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-0b44d5c6-c49b-4972-acda-7b175d257b18-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "cinder-563a752c-3924-4abf-85d3-e970ca296cce-delete_volume" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-563a752c-3924-4abf-85d3-e970ca296cce-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "cinder-quobyte-563a752c-3924-4abf-85d3-e970ca296cce" by "delete_volume" {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-quobyte-563a752c-3924-4abf-85d3-e970ca296cce" acquired by "delete_volume" :: waited 0.015s {{(pid=86261) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ea4919-763f-41ea-bded-c5b3d537178a]: (4, 'qcow2') {{(pid=88024) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:49 devstack sudo[106323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce
Sep 16 08:57:49 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:49 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce" returned: 0 in 0.352s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:49 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce
Sep 16 08:57:49 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:49 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5/volume-563a752c-3924-4abf-85d3-e970ca296cce" returned: 0 in 0.240s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:49 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-quobyte-563a752c-3924-4abf-85d3-e970ca296cce" released by "delete_volume" :: held 0.632s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:57:50 devstack cinder-volume[86261]: DEBUG cinder.quota [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Created reservations ['015aef25-e790-40e8-9528-d5ee83db1aed', 'def1e83c-47ff-4566-a10b-730f88392423', 'c2b0c6d8-c1ad-4cff-a987-ce370ab15d35', '82f708b6-380f-488c-aca0-feeb0f9cd901'] {{(pid=86261) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 08:57:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:57:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:57:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:57:50 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:57:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:57:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:57:50 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:57:50 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:57:50 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Sep 16 08:57:50 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.236s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:57:50 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:57:50 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Deleted volume successfully.
Sep 16 08:57:50 devstack cinder-volume[86261]: DEBUG cinder.coordination [None req-6ec1c5f6-99e3-49ac-b5ff-db142716952e tempest-SnapshotDependencyTests-1573500460 None] Lock "cinder-563a752c-3924-4abf-85d3-e970ca296cce-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=86261) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 08:58:00 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:UPDATE=30,cinder:SELECT=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:58:00 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=27,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 08:58:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:58:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 08:58:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 08:58:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 08:58:12 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8b599d41-4a81-4b12-a5f4-0cd2dafd7ac9'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 08:58:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 08:58:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 08:58:12 devstack sudo[106549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5
Sep 16 08:58:12 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 08:58:12 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root
Sep 16 08:58:12 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd8d3fce614679667338626453232ac5" returned: 0 in 0.245s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 08:58:12 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 08:58:12 devstack cinder-volume[86261]: DEBUG oslo_service.periodic_task [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] Running periodic task VolumeManager._thread_info {{(pid=86261) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 08:58:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread count: 29 {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 08:58:12 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-9adb9caf-a3e2-4e16-bb34-34298a40dc63 None None] thread info: [<_MainThread(MainThread, started 127410046136448)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127409931966656)>, <Thread(Thread-3 (stat_writer), started daemon 127409932317120)>, <Thread(Rabbit-heartbeat, started daemon 127409930713280)>, <Thread(Thread-5 (_runner), started daemon 127409929630784)>, <Thread(Thread-7 (_runner), started daemon 127409929689408)>, <Thread(fd_logger, started daemon 127409927625408)>, <Thread(privsep_reader, started daemon 127409925859520)>, <Thread(Rabbit-heartbeat, started daemon 127409926581440)>, <Thread(tpool_thread_0, started daemon 127409919952576)>, <Thread(tpool_thread_1, started daemon 127409911559872)>, <Thread(tpool_thread_2, started daemon 127409903167168)>, <Thread(tpool_thread_3, started daemon 127409894774464)>, <Thread(tpool_thread_4, started daemon 127409886381760)>, <Thread(tpool_thread_5, started daemon 127409877989056)>, <Thread(tpool_thread_6, started daemon 127409869596352)>, <Thread(tpool_thread_7, started daemon 127409861203648)>, <Thread(tpool_thread_8, started daemon 127409852810944)>, <Thread(tpool_thread_9, started daemon 127409844418240)>, <Thread(tpool_thread_10, started daemon 127409836025536)>, <Thread(tpool_thread_11, started daemon 127409827632832)>, <Thread(tpool_thread_12, started daemon 127409819240128)>, <Thread(tpool_thread_13, started daemon 127409810847424)>, <Thread(tpool_thread_14, started daemon 127409802454720)>, <Thread(tpool_thread_15, started daemon 127409794062016)>, <Thread(tpool_thread_16, started daemon 127409785669312)>, <Thread(tpool_thread_17, started daemon 127409777276608)>, <Thread(tpool_thread_18, started daemon 127409768883904)>, <Thread(tpool_thread_19, started daemon 127409760491200)>] {{(pid=86261) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}